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EXAMINING THE EFFECTIVENESS OF 
THE VETERANS BENEFITS ADMINISTRATION’S 
TRAINING, PERFORMANCE MANAGEMENT 
AND ACCOUNTABILITY 


THURSDAY, SEPTEMBER 18, 2008 

U.S. House of Representatives, 

Committee on Veterans’ Affairs, 
Subcommittee on Disability Assistance 
and Memorial Affairs, 

Washington, DC. 

The Subcommittee met, pursuant to notice, at 10:06 a.m., in 
Room 340, Cannon House Office Building, Hon. John Hall [Chair- 
man of the Subcommittee] presiding. 

Present: Representatives Hall, Lamborn, and Turner. 

OPENING STATEMENT OF CHAIRMAN HALL 

Mr. Hall. Good morning. The House Committee on Veterans’ Af- 
fairs Disability Assistance and Memorial Affairs Subcommittee 
hearing on examining the effectiveness of the Veterans Benefits 
Administration’s (VBA) training, performance management, and 
accountability will now come to order. 

I would ask everyone to rise for the Pledge of Allegiance. Flags 
are located at both ends, actually this end. 

[Pledge of Allegiance.] 

Mr. Hall. Thank you. And welcome again. 

Our Nation’s veterans understand the necessity of proper and 
adequate training. Their lives have depended on it. The military 
trains for its operations and everyone knows every detail of their 
job prior to their mission. 

These same veterans should be able to expect the same level of 
competence when they seek assistance from the Veterans Benefits 
Administration. Unfortunately, that is not always the case as we 
have heard at other meetings and hearings throughout the year 
that this Subcommittee has held regarding the U.S. Department of 
Veterans Affairs (VA) disability claims processing system. 

The VA has standardized its training curriculum and requires 
that all claims processors must complete 80 hours of annual train- 
ing. This is a lot of hours because, in fact, some healthcare pro- 
viders do not need to meet that level of continuing education to 
maintain their clinical license or credentialing. 

The VBA training topics are identified by the Central Office (CO) 
or by the individual’s Regional Office (RO). New employees go 
through an orientation process and there are additional online 

(l) 
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learning tools available through the VBA’s training and perform- 
ance support system. 

Yet, with all this effort, VA training seems to fall short of its in- 
tended goals. Less than 50 percent of the Ratings Veterans Service 
Representatives or RVSRs passed the certification exam even 
though it was an open book test. 

Frankly, I have seen the training manual and it could be meas- 
ured in pounds, not pages. So I do not know how useful the book 
is, especially given the workload that the people being trained are 
already under. But that is sort of the crux of the matter. 

As outlined in previous hearings, there are significant inconsist- 
encies in ratings between the VA’s 57 Regional Offices and a high 
rate of remanded cases. 

I am pleased that the American Federation of Government Em- 
ployees (AFGE) is here to shed light on the issue. You are a critical 
link to those on the front lines working to improve outcomes for our 
disabled veterans. 

The U.S. Government Accountability Office (GAO) released a re- 
port in May 2008 entitled, “Veterans’ Benefits: Increased Focus on 
Evaluation and Accountability Would Enhance Training and Per- 
formance Management for Claims Processors.” That is a long title, 
but sums it up. 

[The GAO Report No. GAO-08-561, which was attached to Mr. 
Bertoni’s prepared statement, appears on p. 71.] 

The report documented areas in which the VA needs to improve 
its training and hold accountable those it does train. 

According to the GAO, staff is not held accountable for com- 
pleting the required training since the VBA does not track comple- 
tion, so there are no consequences for not taking the training. 

Additionally, the VBA does not evaluate its training, so it does 
not know if it is successfully designed and implemented in edu- 
cational program. 

Feedback is not consistently collected from RO employees on the 
training that they do receive and many have reported difficulty in 
accessing training because of their stringent productivity demands. 

I look forward to hearing more from the GAO about this report, 
but these are not surprising conclusions to the Veterans Service 
Organizations who have complained for years about the inadequa- 
cies of the VBA training program. So I am grateful that they have 
joined us here today as well. 

Training is not an issue that should be taken lightly. We all 
know the importance of good training, but effective implementation 
that ensures consistency and accountability can be elusive and that 
is what I hope we can address today. 

I have taken steps to ensure improved training outcomes, we 
have on this Committee when we passed and the full House passed 
H.R. 5892, the “Veterans Disability Benefits Claims Modernization 
Act.” 

These policy enhancements will hopefully lead to compensation 
claims processing improvements and more accurate claims adju- 
dication results for our veterans and their families. 

Moreover, I am not sure that the VBA’s current training regimen 
complements its current claims processing improvement model or 
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CPI. In fact, I am positive that the current coupling detracts from 
increased accountability efforts. 

I am pleased to report that with the help of many in this room, 
H.R. 5892 passed unanimously on July 31, 2008, by the full House. 
On August 1, 2008, Senator Clinton introduced companion legisla- 
tion, S. 3419, in the Senate. 

So, Congress hopefully is on its way to rectifying the inadequa- 
cies in the VBA training system that have already been identified. 

Today’s oversight hearing will allow us to look deeper into this 
issue and gauge where VA is in terms of its training protocol and 
see what other improvements can still be made. 

I look forward to hearing from our witnesses. I hope to learn 
more about best practices and strategies for measuring perform- 
ance, building better training protocols, and accountability stand- 
ards. 

[The prepared statement of Chairman Hall appears on p. 31.] 

And Mr. Lamborn, our Ranking Member, is not present yet, but, 
Mr. Turner, would you like to make an opening statement? If so, 
you are recognized. 

OPENING STATEMENT OF HON. MICHAEL R. TURNER 

Mr. Turner. Sure. Thank you, Chairman Hall. 

Thank you for this opportunity for collective discussion on the ef- 
fectiveness of the Veterans Benefits Administration’s training, 
VBA’s performance management and accounting requirements. 

Over the course of the past several months, this Subcommittee 
has examined nearly every facet of the VA benefits claims process 
system in order to identify how we might help the Department 
overcome the claims backlog crisis. 

While the recent expansion of its workforce will certainly have a 
positive impact, VA must ensure that newly hired claims workers 
receive training that is commensurate with their responsibilities. It 
is critical that the training it provides meets the needs of the De- 
partment and its employees. 

It is equally important that the results of the training are evalu- 
ated. Without feedback, VA may never know whether or not the 
training is accomplishing its goals. 

Any viable training program should be able to identify defi- 
ciencies and demonstrate the intended and actual outcome of the 
curriculum. VA training must be connected to its vision and mis- 
sion and VA managers need to be assured that if employees are 
pulled off the floor for training that it will result in long-term bene- 
fits. 

With the growing number of pending claims, there is a certain 
level of trepidation that there is too much work to do already and 
we will just get further behind if we have to conduct training. 

There must be clear support from the top down in order to con- 
duct adequate training and acquire the expected outcomes. Cer- 
tainly training new employees of everything they need to know in 
order to make sound rating decisions is a daunting task. 

The VA rating schedule itself is complex and it is merely a por- 
tion of the array of knowledge a competent adjudicator must pos- 
sess to perform his or her job. 
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Today’s hearing is an opportunity to not only learn more about 
the training and assessment program VA provides its employees 
but also to reiterate to the Department that it should be forthright 
about any additional resources deemed necessary to fulfill this crit- 
ical requirement. 

Mr. Chairman, I thank you for hosting this hearing on VA’s 
training program and I yield back. 

Mr. Hall. Thank you, Mr. Turner. 

I would like to remind all panelists that your complete written 
statements have been made a part of the hearing record so that 
you can limit your remarks to 5 minutes so we can have sufficient 
time for follow-up questions once everyone has had the opportunity 
to testify. 

Our first panel, the entire panel, is Mr. Daniel Bertoni, Director 
of Education, Workforce, and Income Security Issues at the U.S. 
Government Accountability Office. 

Welcome, Mr. Bertoni, and you are now recognized for 5 minutes. 

STATEMENT OF DANIEL BERTONI, DIRECTOR, EDUCATION, 

WORKFORCE, AND INCOME SECURITY ISSUES, U.S. GOVERN- 
MENT ACCOUNTABILITY OFFICE 

Mr. Bertoni. Mr. Chairman, Members of the Subcommittee, 
good morning. 

I am pleased to discuss training, performance management for 
Department of Veterans Affairs’ disability claims processors. 

Last year, VA paid about $38 billion in benefits to nearly four 
million veterans and their families. 

The disability claims process has chronically suffered from long 
waits for decisions, large backlogs, and problems with accuracy and 
consistency. 

We have also noted that VA’s program is in urgent need of trans- 
formation, especially in regard to how it assesses work capacity 
and provides interventions and support services to veterans. 

To address its management challenges, VA has hired thousands 
of additional staff. However, increased staff alone will not guar- 
antee more timely, accurate, and consistent decisions. 

Among other things, adequate training and performance manage- 
ment will be key to developing new staff and ensuring that more 
experienced staff maintain needed skills. 

My remarks today draw from our prior work for this Sub- 
committee and focus on two areas, VA’s training program for dis- 
ability claims staff and its performance management system. 

Summary. Consistent with accepted training practice, VA has 
taken steps to align its training with the agency’s overall mission 
and goals. For example, in 2004, VA established the Training and 
Learning Board to ensure that training support of VA’s strategic 
and business plans. 

Various analyses. VA has also identified the skills and abilities 
needed by staff and taken steps to determine the appropriate level 
of investment in their training and prioritize funding. 

Finally, we found that VA’s training program for new staff de- 
fined pertinent terms and concepts and provided many realistic ex- 
amples of claims work. However, we did identify areas for improve- 
ment. 
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While the VA collects feedback to assess initial training for new 
staff, not all training is evaluated to determine how relevant or ef- 
fective it is. None of the Regional Offices we visited consistently 
collected feedback on training they provided either for new or expe- 
rienced staff. Thus, VA’s Central Office lacks key information on its 
entire training activities. 

Both new and experienced staff reported concerns with their 
training. Some staff noted that VA’s computer-based learning tool, 
Training and Performance Support System (TPSS), was often out 
of date and too theoretical. 

The more experienced staff reported that they struggle to meet 
VA’s annual 80-hour training requirement due to workload pres- 
sures or the lack of training relevant to their experience level. 

It is unclear what criteria was used to justify the 80-hour re- 
quirement, but identifying the right amount of training is crucial. 
Overly burdensome requirements can take staff away from essen- 
tial tasks while too little training can contribute to errors. 

Putting aside the appropriateness of the current requirement, VA 
has no policies to hold staff accountable for meeting it and may be 
missing an opportunity to convey the importance of training as a 
means to meet individual goals as well as broader agency perform- 
ance goals. 

Regarding performance management, VA’s system generally con- 
forms to accepted practices in that individual performance meas- 
ures such as quality and productivity are also aligned with organi- 
zational performance measures. 

Staff are required to receive regular feedback on performance 
and employees and other key stakeholders were actively involved 
in developing the current system. 

However, we are concerned that under the current rating for- 
mula, VA’s system may not make meaningful distinctions in staff 
performance. Although VA has a five category rating system in the 
field offices we visited, 90 percent of all staff ended up in only two, 
fully successful and outstanding as noted in the chart we provided. 

We have reported that four or five category systems are most 
useful for making performance distinctions. However, if staff rat- 
ings are clustered in only one or two categories as with VA, this 
may be problematic. 

Broad, overlapping performance categories may deprive man- 
agers of information needed to reward top performers, address per- 
formance issues, deprive staff of much needed feedback. 

VA has acknowledged potential issues with the rating formula 
and is considering some adjustments. However, the agency has 
never examined the distribution of all staff across the five perform- 
ance categories. Absent this analysis, VA will lack a clear picture 
of what adjustments are actually needed. 

Conclusion. While VA recognizes the importance of developing 
and maintaining high performing staff, it must devote more atten- 
tion to training and performance management. 

Additional study on such issues as the effectiveness of regional 
training, the appropriateness of the current training requirement, 
and the usefulness of computer-based learning tools is needed. 
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Additional means for holding staff and managers accountable for 
completing training should be explored as well as options for en- 
hancing the current rating system. 

We acknowledge VA’s efforts to hire more staff. However, in the 
longer term, more fundamental changes are needed. VA and other 
Federal disability programs must adopt a more modernized ap- 
proach to determining eligibility for benefits as well as the timing 
and portfolio of services that are provided. 

If progress is made in this area, effective training and perform- 
ance management will be of crucial importance and will impact the 
degree to which service to veterans is ultimately improved. 

Mr. Chairman, this concludes my statement. I am happy to an- 
swer any questions you may have. Thank you. 

[The prepared statement of Mr. Bertoni appears on p. 32.] 

Mr. Hall. Thank you, Mr. Bertoni, for that most incisive state- 
ment and for your written statement as well, which goes into con- 
siderably more detail, of course. 

In your opinion, what is more effective, the classroom training or 
online tools? 

Mr. Bertoni. I do not know what individual mode of training is 
most effective. I think any training program should have a mix of 
classroom training, on the job, and online, computer-based tools. 

Agencies should be looking at and evaluating each of those, call 
it the three-legged stool, to ensure that they complement each 
other, they are consistent in terms of the information they convey, 
and they are meeting the needs of staff. 

Mr. Hall. What did you think of the VA’s learning management 
system and training and performance support system? 

Mr. Bertoni. Generally we used an in-house criteria to assess 
the four components of training system and generally there are 
four. Our criteria is based on various external experts, internal ex- 
perts at GAO, private-sector individuals, nonprofits, and academia. 
And we came up with a criteria that we use quite often to evaluate 
training and performance management. 

Generally we break this apart into four categories, planning, de- 
sign, implementation, and ultimately evaluation. 

And as our report notes, I think VBA and VA are doing an ade- 
quate job in many respects. They have aligned their training with 
broader agency goals. They have aligned their performance man- 
agement system and with their measuring folks on with their 
broader agency goals and mission. 

So they are doing, I think, many things well relative to accepted 
practices, but still are falling short in terms of in the area of feed- 
back. Feedback is essentially your evaluation loop. That is how you 
find and determine whether your training is relevant, whether it 
is effective, and whether it is being delivered at the appropriate 
time. To the extent you are not getting that feedback, I think you 
are missing an opportunity. 

They do a great job or a better job early on for the initial orienta- 
tion training, but I think things fall off as staff return to their 
home units and begin taking training. And it is harder for us to 
get a handle on uniformity, consistency, and whether it is as effec- 
tive as it could be. 

Mr. Hall. Thank you, Mr. Bertoni. 
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I understand that proper training is vital to efficiency and accu- 
racy, but is training the bottom line problem at VBA? Would you 
correlate the problems inherent in the backlog as an issue with 
training? 

Mr. Bertoni. It is hard to isolate all the factors that contribute 
to the backlog. There are laws, regulation that have contributed. 
There are management inefficiencies that have contributed. But 
training certainly is a tool to get at or to address many of the prob- 
lems that agencies face. We would not do it if we did not think it 
was worthy. 

And clearly when you have good training, you can see results. 
Whether you can, you know, measure clear cause and effect, that 
is probably not something that you can always do. But generally 
a good, solid designed training system is effective. 

Beyond training, I do really believe that part and parcel with 
that is a good quality assurance process. Until you know where 
your soft spots are, where your problems are through your quality 
assurance reviews, it is very hard to design training that is going 
to really target and get at the problematic areas in your process. 

We have gone many years with timeliness, accuracy, and consist- 
ency issues, and I have to believe based on some work that we have 
done looking at the STAR system and other quality assurance proc- 
esses that having more robust quality assurance could help VBA, 
VA identify some of the real root causes for inconsistency and inac- 
curacies. 

And I think they really need to focus on that. And it appears 
from the statement I read from VA this morning they are heading 
in that direction. 

Mr. Hall. In reviewing VBA’s performance management system, 
how different was it from other Federal agencies? Three-part ques- 
tion here. Are there other agencies with a better performance man- 
agement system that VA could adopt and would it make sense to 
give performance credits for training as well as for work completion 
so that there is not pressure to stay on the workload and not train? 

Mr. Bertoni. I do not know if it is a matter of giving credits for 
workload completion. I believe their rating should reflect the fact 
that they are doing a good job or a great job in terms of processing 
the workloads. 

Our concern with their performance management system is that 
it may not be rewarding. It may, in fact, be potentially demor- 
alizing for some staff. 

I will give you an example. We’ll use three people. You take the 
first person who is clearly a high flyer who rates exceptional across 
all the critical and noncritical dimensions. That person, it is a no- 
brainer. That person would be listed in the outstanding category. 

We will take another person who is just barely at the fully suc- 
cessful level and, you know, just barely eking out a fully successful 
rating, marginally falling below that, but at the end of the perform- 
ance year ends up with a fully successful rating. 

Take a third person who is clearly also a high performer. That 
person gets exceptional ratings on all dimensions, critical and non- 
critical. With the exception of one, that person gets a fully success- 
ful. That individual will be dumped into the bucket with that fully 
successful person. 
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Clearly that person falls somewhere between exceptional and 
outstanding, but because of that one fully successful in a critical 
dimension are dropping down into that lower bucket and all the in- 
centives, the pay incentives, the other monetary incentives are not 
available. 

So if you are trying to create a world-class organization and 
incentivize people for hard work, this example really disturbs us. 
We see in the four regions that we visited 90 percent of all folks 
in two categories and nobody in that second excellent category. It 
gives me pause. 

Mr. Hall. Thank you, Mr. Bertoni. 

My time is expired. I will now recognize and welcome our Rank- 
ing Member, the gentleman from Colorado, Mr. Lamborn. 

Mr. Lamborn. Yeah. And thank you, Mr. Chairman. 

Mr. Bertoni, you apparently have some familiarity with other de- 
partments other than the VA because of looking at training pro- 
grams in other parts of the Federal Government. 

What are some successful components that you have seen in 
some of these other areas that you would suggest the VA should 
imitate? 

Mr. Bertoni. Again, I will hearken back to what we identified 
in our report. I think you really need to foster a rigorous system 
for feedback and evaluation. If you are focusing on new employees 
at the initial orientation level and getting good information there, 
fine. We acknowledge that. 

But when these folks transfer back or go out into their home 
units and are taking this, you know, training at the regional level, 
there is no feedback loop that is feeding back into VBA’s head- 
quarters so they can use this information to identify areas where 
they are falling short and ultimately to devise training to get at 
some of the problems that we have talked about in the area of ac- 
curacy and consistency. 

World-class organizations have completed that wheel, planning, 
design, implemented, and your evaluation loop. To the extent that 
all those elements are firing, you have better systems. And there 
are some organizations that do better than others. 

Mr. Lamborn. Thank you. 

Mr. Chairman, I yield back. 

Mr. Hall. Thank you, Mr. Lamborn. 

And one more question, Mr. Bertoni. In 2001, the GAO issued a 
report “Veterans Benefits Training for Claims Processors Needs 
Evaluation.” At that time, the GAO found that the TPSS was being 
implemented differently in each Regional Office. I know that the 
VBA has mandated some of the training, but employees have 
raised concerns about the training and claim limited time for it be- 
cause of workload demands. 

So what differences do you see in the VA’s training process from 
that time, from 2001 to the present? 

Mr. Bertoni. We really did not delve into the TPSS system. We 
had the prior report. We followed up our recommendations. 

I know that VA has taken steps to monitor and approve that sys- 
tem. I think there is an ongoing effort and I think almost a report 
to be issued shortly also. But we really did not delve into the sys- 
tem exclusively. 
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We were only able to sort of give a snapshot of what was going 
on in the four Regional Offices and there was clearly some noise 
that the TPSS system was not all it could be for some folks in 
terms of the timeliness of the information in there, the relevance, 
especially in regard to the collection of medical evidence. I believe 
that came up frequently. 

But this was not a look at TPSS. It was sort of a broad-based 
review of all the elements and tools that are there for staff to use. 

Mr. Hall. Okay. Well, that is all the questions I have. Mr. 
Lamborn, if you are done, I would thank you, Mr. Bertoni, again 
for your testimony. And your panel is now excused. 

Mr. Bertoni. Thank you. 

Mr. Hall. And thank you so much. 

And joining us now on our second panel, we would like to wel- 
come Mr. Michael Ratajczak — is that correct 

Mr. Ratajczak. Ratajczak. Thank you. 

Mr. HALL [continuing]. Decision Review Officer at the Cleveland 
Veterans Affairs Regional Office on behalf of the American Federa- 
tion of Government Employees; Mr. Kerry Baker, Assistant Na- 
tional Legislative Director of the Disabled American Veterans 
(DAV); Ronald Abrams, Joint Executive Director of the National 
Veterans Legal Services Program (NVLSP); Dr. Patricia Keenan, 
Manager of Employee Performance Enhancement and Growth Pro- 
gram at the Human Resources Research Organization (HumRRO); 
and Mr. Nick Bartzis, a veteran from Cleveland, Ohio. 

Welcome, all, and your statements, written statements are in the 
record so that we will allow you to deviate and ask you to stay 
within the 5 minutes so we have time for questions for everybody. 
Tell me one more time. Ratajczak. 

Mr. Ratajczak. Ratajczak. 

Mr. Hall. Ratajczak. Mr. Ratajczak, you are now recognized for 
5 minutes. 

STATEMENTS OF MICHAEL RATAJCZAK, DECISION REVIEW 
OFFICER, CLEVELAND VETERANS AFFAIRS REGIONAL OF- 
FICE, VETERANS BENEFITS ADMINISTRATION, U.S. DEPART- 
MENT OF VETERANS, ON BEHALF OF AMERICAN FEDERA- 
TION OF GOVERNMENT EMPLOYEES, AFL-CIO; KERRY 
BAKER, ASSISTANT NATIONAL LEGISLATIVE DIRECTOR, DIS- 
ABLED AMERICAN VETERANS; RONALD B. ABRAMS, JOINT 
EXECUTIVE DIRECTOR, NATIONAL VETERANS LEGAL SERV- 
ICES PROGRAM; PATRICIA A. KEENAN, PH.D., PROGRAM 
MANAGER, HUMAN RESOURCES RESEARCH ORGANIZATION 
(HUMRRO); AND NICHOLAS T. BARTZIS, CLEVELAND, OH 
(VETERAN) 

STATEMENT OF MICHAEL RATAJCZAK 

Mr. Ratajczak. Thank you. 

I think I have as much practical experience with regard to train- 
ing issues at the VBA as anyone in the room. I served as central- 
ized challenge instructor. I worked on the certification design Com- 
mittees. I have identified trends in errors by interacting with 
Board of Veterans’ Appeals (BVA) personnel. I have taken some re- 
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medial action to fix errors resulting from what ultimately is im- 
proper and effective training. 

As a Decision Review Officer every day, I kind of am serving as 
a forensic pathologist where I look at a case where a mistake was 
made and trying to assign a reason for that mistake. When I have 
done that more often than not, I will effectively as possible take the 
case to the person who may have made the mistake and say this 
is what you did, let us try and avoid that in the future. 

More often than not as an explanation for their actions, the folks 
who made an error will attribute the error to the fact that, well, 
I just did not know that. I was not trained. I do not even know 
where to find that information. 

To the extent that errors are made, it is obviously a reflection of 
improper training on behalf of the VBA. 

And what I would like to submit is that the folks who are mak- 
ing these errors, the front-line claims adjudicators, veterans rep- 
resentatives, specialists, decision officers, they have an interest in 
effective training. They do not want to make mistakes because as 
we all do, they have service to veterans at heart ultimately. 

But beyond that, if they are making mistakes, adverse employ- 
ment action can be taken against them. They can be put on a pro- 
duction improvement plan. So they have a very real interest in ef- 
fective training and participating in effective training. 

To the extent that that opportunity for effective training is not 
presented to them, I think we can do better. 

I was struck by the testimony in previous hearings before this 
Subcommittee and others regarding complexity, increasing com- 
plexity of the process, judicial review, explanations for why there 
is a backlog in the VBA. 

And all that is true. VBA no longer operates in splendid isolation 
for judicial review, so the court comes back and looks at VBA’s 
processes and says, well, this is what you need to do, this is what 
you are not doing correctly. 

Those kind of decisions should be viewed more as an opportunity 
than as an impediment because we can take those decisions, take 
the reasoning in them, and identify things they need to be trained 
on so we avoid the mistakes in the future. 

Recognizing that there is a component to the backlog which is at- 
tributable to complexity in legal review, VBA, I do not think, has 
made the same leap to the fact that those same elements have a 
detrimental impact on an individual employee’s ability to do their 
job. 

Obviously if a given claim is more complex and there are addi- 
tional legal requirements placed on the Veterans Service Rep- 
resentatives (VSRs) and Rating Specialist, it is going to take them 
longer to do their job and maybe what we could do is design some 
effective training to make them more efficient in doing their job in 
the face of increasing complexity and increasing legal require- 
ments. I am going to suggest briefly a couple of methods of doing 
that based on my experiences. 

I just want to note that I did read the GAO report. I think over- 
all it is accurate, but I want to caution anybody who will listen to 
the extent that it may imply that individual claims processors are 
responsible for improper training, that cannot be the case. They do 
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not have the ability to go to their management and say, hey, I need 
more training. You need to do that so I can do my job better. 
Frankly, that is someone else’s job to do that training and give 
them the opportunity for it. 

Several actions can be taken to include training. Number one, 
centralize curriculum from Central Office implemented by instruc- 
tors that are responsible to Central Office. That would provide a 
uniform voice to all Regional Offices. This is CO’s policy. 

To the extent that adjudicators’ experience will be informed by 
that uniform training, you would expect to get some uniformity and 
some more consistency in the decisions. 

Also, I think Veterans Service Representatives, Rating Special- 
ists in particular, should be given work credit for doing deferred ac- 
tions where they have direct additional development in a claim to 
the person who is responsible for developing the evidence. That 
would provide feedback to people developing the evidence and also 
an incentive to the Rating Specialists. 

Thank you. 

[The prepared statement of Mr. Ratajczak appears on p. 39.] 

Mr. Hall. Thank you, Mr. Ratajczak. 

Mr. Baker, now you are recognized for your statement. 

STATEMENT OF K ERRY BAKER 

Mr. Baker. Mr. Chairman and Members of the Subcommittee, on 
behalf of the DAV, I am pleased to offer my testimony to address 
VA’s training, accountability, and performance measurement sys- 
tem. 

VA has a standard training curriculum for new claims processors 
and an 80-hour annual training requirement for all claims proc- 
essors. 

DAV has long maintained that the VA should invest more in 
training and hold employees accountable for higher standards of 
accuracy. 

VA’s problems caused by a lack of accountability do not begin in 
the development and the rating process and in the training pro- 
gram of which we can find little, if any, measurable accountability. 

For example, some employees inform DAV that many candidates 
begin centralized training before they complete or even start phase 
one training. Candidates are then not held responsible via formal 
testing on subjects before advancing to phase two training. 

As in phase one, VA refuses to test phase two trainees. Without 
such testing, VA cannot gauge the success of its learning objectives. 

During phase three training, employees work on real world cases. 
That notwithstanding, no accountability, no testing, and no over- 
sight other than that provided locally. That oversight is not meas- 
ured nationally. 

The result of such an unsupervised and unaccountable training 
system is that no distinction exists between unsatisfactory perform- 
ance and outstanding performance. Lack of accountability during 
training eliminates employee motivation to excel. 

The need for improvements in VA’s training program became evi- 
dent when it began the skills certification test for VSRs. The first 
two attempts at the test produced a 25- and a 29-percent pass rate. 
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The third produced a 42-percent pass rate but only after employees 
completed a 20-hour prep course to pass the test. 

Mandatory, comprehensive testing designed cumulatively one 
subject area to the next for which VA then holds trainees account- 
able should be the number one priority of any plan to improve VA’s 
training program. 

Further, VA should not allow trainees to advance to subsequent 
stages of training until they have successfully completed such test- 
ing. 

DAV has also long stated that in addition to training, account- 
ability is the key to quality. Therefore, timeliness. 

We believe VA’s quality assurance or STAR Program is severely 
inadequate. In 2006, the STAR Program reviewed just over 11,000 
compensation and pension (C&P) claims for improper payments. 
There was only .72 percent of the total number of cases available 
for review. However, a more reliable measure of VA’s accuracy and 
its lack of accountability is shown through the Board of Veterans’ 
Appeals’ annual report. 

Fiscal year 2007, the Board decided approximately 40,000 ap- 
peals. The Board reversed 21 percent of those appeals and re- 
manded over 35 percent. Of those remands, over 7,000 of those 
cases or nearly 20 percent were remanded because of errors in the 
most basic of procedures, procedures that should be elementary to 
every single decision-maker. 

The problem is compounded when one considers that those errors 
cleared the local Board, local Rating Board and the local Appeals 
Board which contain VA’s most senior Rating Specialists. These 
facts clearly show little incentive for many employees to concern 
themselves with the quality of their work. 

Congress should require the Secretary to report on how the De- 
partment could establish a quality assurance and accountability 
program that will detect, track, and hold responsible those employ- 
ees who commit errors. 

We believe that effective accountability can be engineered in a 
manner that would hold each VA employee responsible for his or 
her work as a claim moves through the system while simulta- 
neously holding all employees responsible. 

If such errors are discovered, employees responsible for such er- 
rors should forfeit a portion of their work credit. This idea is dis- 
cussed more in my written testimony, but I would be happy to ex- 
plain further if the Committee has questions. 

I believe this type of accountability system will draw on the 
strengths of VA’s performance measurement system, thereby allow- 
ing easier and less disruptive implementation of stronger and more 
effective accountability. 

Mr. Chairman, that concludes my statement, and I will be happy 
to try to answer any questions you might have. 

[The prepared statement of Mr. Baker appears on p. 42.] 

Mr. Hall. Thank you, Mr. Baker. 

Now, Mr. Abrams, you are recognized for 5 minutes. 
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STATEMENT OF RONALD B. ABRAMS 

Mr. Abrams. Good morning, Mr. Chairman and Members of the 
Committee. I am pleased to have the opportunity to submit this 
testimony on behalf of NVLSP. 

As some of you know, we have trained thousands of service offi- 
cers and lawyers in veterans’ benefits law. We have written books, 
textbooks, and guides on veterans’ benefits and we help people rep- 
resent veterans seeking VA benefits. 

We also conduct quality reviews of the VA Regional Offices on 
behalf of the American Legion. We believe after reviewing all of 
this that the effectiveness of VBA training should be measured by 
the quality of the work product produced by VA adjudicators. 

Therefore, the quality and timeliness of VA adjudication should 
reflect the effectiveness or lack thereof of VA training. Because the 
quality of VA adjudications is in our opinion inadequate, NVLSP 
must conclude that VBA training is not effective or adequate. 

In the experience of NVLSP over 10 years of quality checks, over 
40 VA Regional Offices combined with extensive representation be- 
fore the Veterans Court, we find that most of the worst VA errors 
are the result of premature Regional Office decisions. 

We find that many VA managers emphasize quantity over qual- 
ity, making many aspects of training not relevant. That is because 
VA workers want to please the people they work for. Training is 
de-emphasized because production is paramount. 

VA employees consistently let us know that they are told that 
time spent training reduces the time available to produce decisions. 
Also training VA workers regarding the procedures designed to pro- 
tect the rights of claimants, developing the claim fully, reviewing 
the entire file instead of top sheeting, which is just looking at the 
first couple of pages — all takes time. The essence of fairness in this 
particular process is giving the VA worker the time to do the job. 

In fact, in September 2008, courageous VA Regional Office em- 
ployees filed a grievance exposing this overemphasis on production. 
That grievance is attached to my testimony. The grievance asserts 
that the Regional Office created and encouraged a culture in which 
quantity is emphasized to the detriment of quality, that the RO 
failed to properly implement training to assure that those review- 
ing claims are sufficiently trained and that the RO failed to prop- 
erly implement a fair and impartial performance appraisal system 
that assures that quantitative measures of performance are not 
emphasized to the detriment of measures of quality. 

These VA workers allege they were told to produce cases. It did 
do not care about the quality of their work or it did not care that 
much. And we think that the quality of the VA work is much worse 
than what is reported by the VA. 

As Kerry testified, the BVA statistics are scary. If over 50 per- 
cent of what goes up to the Board of Veterans’ Appeals has to be 
returned because the VA in general failed to follow proper process, 
we have a problem. That is the best quality check possible. 

I want to thank you for permitting NVLSP to testify on this im- 
portant issue. I will be happy to take any questions. 

[The prepared statement of Mr. Abrams appears on p. 47.] 

Mr. Hall. Thank you, Mr. Abrams. We will have some questions 
for you. 
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Dr. Keenan, you are now recognized. 

STATEMENT OF PATRICIA A. KEENAN, PH.D. 

Dr. Keenan. Good morning, Mr. Chairman and Members of the 
Subcommittee. I am Patricia Keenan, a Program Manager at the 
Human Resources Research Organization or less formerly and 
more shortly is HumRRO. 

HumRRO is a nonprofit 501(c)(3) research and development orga- 
nization established in 1951 that works with Government agencies 
and other organizations to improve their effectiveness through im- 
proved human capital development and management. 

Our comment today is about the compensation and pension serv- 
ices training program as well as on methods to reduce training 
variance. 

I am the project leader for HumRRO’s work with VBA skills cer- 
tification programs. HumRRO has worked closely with C&P service 
on skill cert programs for Veterans Service Representatives or 
VSRs since 2001. 

We have seen passing rates on the VSR test rise steadily since 
the beginning indicating to us that C&P’s training initiatives are 
having a positive effect. 

As part of our work, we conducted numerous focus groups and 
interviews at Regional Offices. As a result, we identified several 
factors that decrease rating consistency. 

First, the RVSR job is very cognitively demanding. It requires 
knowledge of medical conditions, regulations, and the rating sched- 
ule, attention to detail, decisiveness, and strong analytical ability. 
These requirements exacerbate the other challenges RVSRs face. 

The second factor we identified is the problem of incomplete in- 
formation in the rating schedule. While the schedule contains over 
700 diagnostic codes, by comparison, the international classification 
of diseases by the medical profession contains thousands of codes. 

Many areas of the rating schedule leave room for interpretation 
and RVSRs develop individual rules for matching the medical evi- 
dence to the schedule. This allows them to reduce the cognitive 
load and work more quickly, but it also is a source of rating vari- 
ance. 

The rating schedule does not have diagnostic codes for some con- 
ditions such as Parkinson’s disease or carpal tunnel syndrome. 
When a claim includes an unlisted condition, the RVSR rates it by 
analogy to a closely related disease or injury. By their nature, 
these analogous codes lack criteria for rating, so raters have to re- 
search different conditions to make the evaluation that may not be 
very straightforward. 

The third challenge to the RVSR is related to workload. The 
sheer volume of cases awaiting adjudication sometimes results in 
a lack of attention to detail. One way this shows itself is in cases 
that are not ready to rate and require additional development. This 
means the RVSR has spent time reviewing a case, but the decision 
must wait for new information and the case must be reviewed a 
second time. 

The pressure also shows itself in rating decisions that rely too 
heavily on the use of templates rather than clearly establishing the 
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connection between the medical evidence presented and the regula- 
tions in a way that is easily understandable. 

It is very important that veterans feel confident that their cases 
have been fairly evaluated. 

VBA’s recent wave of hiring was the best long-term response to 
the influx of claims. However, one result has been that newly hired 
RVSRs do not understand the development process well. 

Although the workload of the RVSR is not going to lighten in the 
near future, there are some actions that could help improve rating 
consistency. 

First, to address one of the workload issues, newly hired RVSRs 
should work predetermination for several weeks to learn the sys- 
tem. The obvious drawback to this is that it would take longer for 
new RVSRs to begin rating cases. But we believe having this addi- 
tional knowledge would pay off in the longer term. 

Second, job aids that include more specific medical information 
and rating schedule would ease the cognitive complexity of the job 
and reduce the individual interpretation of the ratings. However, 
job aids cannot help with the complex problem of writing good rat- 
ing decisions. 

One long-term solution to this problem would be to develop a se- 
lection tool that assesses an applicant’s ability to synthesize infor- 
mation and present it in a well-structured, easily comprehensible 
document. 

Finally, VBA should ensure that all RVSRs continue to receive 
standardized training. 

It has been HumRRO’s pleasure to work with the C&P service 
for the past 7 years. We are honored to be even a small part of the 
valuable work the Veterans Benefits Administration does for Amer- 
ica’s veterans. We have watched both the skill certification pro- 
gram and C&P service over this time. The effort devoted to train- 
ing has been steadily improving pass rates on the test. 

Beyond training, we have identified several areas that could fur- 
ther increase rating consistency. Addressing the problems of cog- 
nitive complexities, ambiguity in the rating schedule, and workload 
is something VBA should continue. 

Thank you for this opportunity. 

[The prepared statement of Ms. Keenan appears on p. 61.] 

Mr. Hall. Thank you, Dr. Keenan. 

Mr. Bartzis, you are now recognized for 5 minutes. 

STATEMENT OF NICHOLAS T. BARTZIS 

Mr. Bartzis. Thank you, sir. 

Thank you for the invitation to speak here today as a veteran 
and I am here today as a private citizen. However, I have a few 
statements beyond my written statement to go through. Most of 
them are in the form of 

I raise my right hand approximately 20 inches. I am going to 
show approximately a half an inch with my left hand. If we deter- 
mine we have two cases, the cases make the mistake, make the 
same mistake on the same issue, how long is it going to take to 
go through all of the medical evidence on the case on the right as 
opposed to the case on the left? The answer to that question to me 
or the question itself is how much time is it going to take? 
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But what I am really talking about is time. If I have to go 
through 20 inches of medical evidence or if I have to go through 
'/4 inch or V2 inch of medical evidence, I am going to spend a sig- 
nificantly different amount of time to find the error. 

It has been stated earlier that part of the problem is the develop- 
ment issue, but the actual issue is how much time does it take and 
who is going to do it. That is a question I believe the Committee 
should ask. 

The second issue is accountability. Who is going to do it and 
when and where is a failure, if any? 

The rest of the statements are in my written statement, and I 
will defer to that. Thank you very much. 

[The prepared statement of Mr. Bartzis appears on p. 65.] 

Mr. Hall. Thank you, Mr. Bartzis. 

I will recognize myself now for a round of questions. 

Mr. Ratajczak, what happens when RO staff cannot complete the 
80 hours of training? 

Mr. Ratajczak. To the best of my knowledge, nothing happens. 
I do not think there is any detrimental effect on the individual ad- 
judicator if they have not concluded their training requirements. I 
suppose that there would be some method in place for them to do 
some remedial training. But to the extent that they are not held 
accountable for ensuring the training to begin with, nothing hap- 
pens. 

As far as a practical matter, what happens is they do not get 
enough training and obviously we get poor decisions and increasing 
appeals. 

Mr. Hall. Dr. Keenan, you spoke of new hires having an initial 
period of, if I understood you correctly, of training before they start 
working on cases. 

What amount of time do you recommend and is that something 
that you have seen succeed in other similar situations in other 
agencies? 

Dr. Keenan. For them to work predetermination before they 
start rating cases? 

Mr. Hall. Right. To just have a concentrated training period be- 
fore they start rating cases. 

Dr. Keenan. Well, right now they do have a 3-month training pe- 
riod before they start rating, but they do not have enough time to 
learn all the intricacies of predetermination which is all the evi- 
dence gathering that is required for the RVSR then to be able to 
make ratings, solid ratings. So if they could spend an extra 6 or 
8 weeks doing pre-d, just learning the whole claims process. 

What we heard in our visits to the ROs was that the people who 
are promoted internally to RVSRs, it is a road running much more 
than people who are hired from the outside. 

Mr. Hall. Yes. 

Dr. Keenan. And that makes perfect sense. It is a very com- 
plicated process. There is a lot to learn in PR and when you are 
doing a rating decision, you have to understand, you have to be 
able to look at the evidence and know that you have enough there 
to make your decision. 

If the VSR has not developed all of that information and you do 
not know this and you spend time going through your case and 
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then have to defer it, as Michael mentioned before, so if they could 
spend more time once they have gone through their initial training 
and then go through pre-d, spend some time, they will still be 
working cases in pre-d, so they are helping in that sense getting 
things ready to rate, they will have a much better sense of the 
whole process. 

Mr. Hall. So rather than 3 months, you suggest 4 or 5 months, 
in effect? An additional 6 to 8 weeks, you said? 

Dr. Keenan. Yes. 

Mr. Hall. Why do you think Dr. Keenan, so many VBA employ- 
ees had a problem in passing the open book test that you devel- 
oped? 

Dr. Keenan. When VBA first told us they wanted an open book 
test, we were totally dumfounded. We do a lot of certification work 
and it is always closed book. You come in on a Saturday. You take 
the test. 

But once we realized the complexity of the job and the fact that 
people really cannot do their job just with their memory, it is just 
too complicated, there are too many rules, too much money, too 
many regulations, they have to have training aids, job aids, you 
know, regulations available to them so that they can make these 
decisions. 

The tests are fairly applied, so it is not just a matter of recall 
which screen you use for that, although those are important to 
know because it makes you work more efficiently. The 

Mr. Hall. So you think they need more time to take the test? 

Dr. Keenan [continuing]. Well, we actually just had a meeting 
about that yesterday. We are going to add 

Mr. Hall. Because it is a learning experience? The test itself? 

Dr. Keenan [continuing]. We want them to learn while they are 
testing. 

Mr. Hall. Right. 

Dr. Keenan. We hope that they will come in knowing that. And 
we had originally set the time limit. It is a two part test, half in 
the morning and half in the afternoon, 2 hours and 45 minutes in 
the morning and 2 and 45 in the afternoon. We are going to expand 
that to a full 3 hours both times. 

Mr. Hall. Thank you. I am sorry to have to interrupt you, but 
I only have a little bit of time left in this round. 

Mr. Baker, in your testimony, you mentioned that the VBA does 
not test participants after each phase of training. 

Do you think it would be better to test at these intervals instead 
of the certification exam or in addition to the certification exam? 

Mr. Baker. Well, if I may clarify. It sounded like I was pretty 
rough on VA employees there and I want to make sure that you 
know I was not aiming at VA employees. It was the system that 
I would like to see improved. 

But to answer your question, I think it should be both, absolutely 
testing during the training phases, cumulative testing, so that you 
are responsible for what you learned in the previous phase and the 
current phase and so on and so on. 

I agree with the open book because my opinion this is more of 
a legal system than anything else and as complex it is, people need 
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to know where to find it. And I would go as far as to have those 
resources cited in the answers. 

But if there was some incentive to do that, I think you would end 
up with a lot better training right up front. 

Mr. Hall. With Mr. Lamborn’s patience and agreement, I am 
going to just go on and ask a couple more questions even though 
the red light is on. 

Mr. Abrams, what steps would you recommend that VA follow to 
improve their training program and, in particular, should VBA 
training be contracted out to lawyers and doctors who specialize in 
disability compensation cases? 

Mr. Abrams. The first thing that we would recommend is that 
we make upper management accountable by evaluating the BVA 
reversal and remand rate. We are not confident in the STAR Pro- 
gram. We do know many of the VA managers and they are good 
people. They are smart. And if their promotions and raises were 
contingent in part on the quality of the work performed at their 
Regional Office or for Central Office, the national figures, I have 
confidence that they would implement a real good training program 
because it would affect them. 

Right now it does not affect anybody when things are not good 
at the Board or even at the court where I know that we screen 
many, many cases. And the ones we take, we win over 90 percent 
of the time because there are many process errors. 

Can you ask your second question again? 

Mr. Hall. The second question, and this relates to various as- 
pects of the VA’s work, because of the backlog, the workload and 
the complexity and funding or staffing difficulties over the years, 
we keep running up against privatization proposals. But in par- 
ticular, this is training I am talking about. 

Mr. Abrams. Right. 

Mr. Hall. Should VBA training be contracted out to lawyers and 
doctors who specialize in disability compensation cases? 

Mr. Abrams. Well, I will tell you, on one of our quality trips, I 
was asked by the Regional Office manager to train the Rating 
Boards in an area where we all agree they were making error after 
error. And after I was finished training, they came up to me and 
said we would like to do what you say, but we do not have time. 

When I got back to DC, I realized that we have an ethical issue 
here. If we are going to sue the VA in Federal Court as a matter 
of practice, if we are going to represent veterans, I am not certain 
that most knowledgeable lawyers who represent veterans before 
the VA, the Board, and the courts should be involved in training 
the VA too. It seems to put the advocate on both sides of the table. 

I think that if the VA wants to contract, I think that the people 
who do that may have to give up their other duties. There is a real 
tension there to me. 

Mr. Hall. Okay. Thank you so much, Mr. Abrams. 

Mr. Bartzis, you testified in your written statement that nation- 
wide for the period of January 1, 2007, through September 5, 2008, 
the training and performance support system basic rating comple- 
tion report lists 2,115 RVSR employees. Only 124 have completed 
the TPSS portion of the training. This is a completion rate of 17 
percent. 
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Could you elaborate on this point, please? 

Mr. Bartzis. First, I would like to state that there is a calcula- 
tion error. The error is, it is not 17 percent completion rate. It is 
a 5.8 percent completion rate. 

Second, it is common knowledge of myself and other people, VA 
employees that I speak with that TPSS does not get completed. 
What we have is a complex system and we have multiple layers of 
people who get employed at different times. 

One layer of employee hired at a certain date may only complete 
portions of the basic completion report. Another section might com- 
plete half of it. Another section might complete a very small por- 
tion. 

In order to elaborate, what this shows me is a very low percent- 
age of VA employees have completed the scheduled training. 
Whether it is 5.8 percent or 17 percent or 50 percent, what we have 
is a significantly low portion of a completion of training during a 
specified time period. 

Mr. Hall. Thank you, Mr. Bartzis. 

I will now recognize Mr. Lamborn. 

Mr. Lamborn. Thank you, Mr. Chairman. 

And I have a couple of questions for Mr. Ratajczak. 

There seemed to be three main bodies of knowledge that the VA 
employees who are doing this need to be aware of, the VA rating 
schedule, Title 38, and precedent court decisions. 

Are you finding in your review of erroneous decisions that one or 
more of those areas are where there needs to be extra training? 

Mr. Ratajczak. I would say it is the application of court deci- 
sions and continuing legal requirements to the actual development 
of cases insofar as that interacts with the veterans. 

It is not hard, well, I should not say it is not hard, but it is easier 
to rate or adjudicate a claim, make the decision with regard to the 
entitlement service connection, evaluation, and effective date if all 
the evidence is before you. 

When the evidence is not before you, when the case is not prop- 
erly developed, it becomes difficult if not impossible to do that cor- 
rectly. Given the time constrains that folks have to make these de- 
cisions, oftentimes they are not given any incentive to actually 
make the case right before they make the decision. 

So I think the real crux of the problem is that the folks who are 
developing the evidence need to know what they are developing 
and why they are developing it and how to do that. And that, I 
think, is informed by the case law and the regulations. 

Mr. Lamborn. Okay. Thank you. 

And, secondly, in the area of centralized training curriculum, 
which you were referring to from the Central Office, who do you 
think should develop this? Should it be experienced field employees 
or is there also a role for outside experts? 

Mr. Ratajczak. Well, the one thing that the GAO report points 
out is that Central Office staff does a very good job with regard to 
developing a curriculum for initial hires. And to that extent, I 
think that the Central Office staff as it exists now maybe with 
some additional personnel would be able to design a curriculum 
that is relevant to new issues as they develop and design a cur- 
riculum that sets forth the best practice with regard to how these 
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issues should be dealt with by folks out in the field, some language 
that they can use in their rating decisions so that they are legally 
sufficient. 

I think that might be the better way to go simply because those 
folks that are already in VBA are already familiar with the proc- 
ess. If we were to go out and try to contract out, get someone else 
to do it, I think that there would be a very large lag time, number 
one. 

And, number two, ultimately the training has to be responsive 
and coordinated with what the policy of the VBA is. Contracted 
lawyers, et cetera, who are not interpreting that policy and those 
practices, we may get a good disconnect. 

Mr. Lamborn. Okay. Thank you for your answers. 

And thank you all for your testimony. 

Mr. Hall. Thank you, Mr. Lamborn. 

We have more questions, but what we are going to do is submit 
them to you in writing. And you have provided lots of answers in 
your testimony to begin with. 

So, Mr. Ratajczak, Mr. Baker, Mr. Abrams, Dr. Keenan, Mr. 
Bartzis, thank you for your work on behalf of our Nation’s 
servicemembers and veterans. And you are now excused. Thank 
you very much. 

And joining us in our third panel is Michael Walcoff, Deputy 
Under Secretary for Benefits of the Veterans Benefits Administra- 
tion at the Department of Veterans Affairs. 

Mr. Walcoff is accompanied by Dorothy Mackay, Director of Em- 
ployee Development and Training of the Veterans Benefits Admin- 
istration, and Bradley Mayes, Director of Compensation and Pen- 
sion Service of the VBA at the Department of Veterans Affairs. 

Of course, you know the routine. Your written statement is made 
a part of the record, so feel free to deviate from it. Mr. Walcoff, you 
are now recognized for 5 minutes. 

STATEMENT OF MICHAEL WALCOFF, DEPUTY UNDER SEC- 
RETARY FOR BENEFITS, VETERANS BENEFITS ADMINISTRA- 
TION, U.S. DEPARTMENT OF VETERANS AFFAIRS; ACCOM- 
PANIED BY DOROTHY MACKAY, DIRECTOR, EMPLOYEE DE- 
VELOPMENT AND TRAINING, VETERANS BENEFITS ADMINIS- 
TRATION, U.S. DEPARTMENT OF VETERANS AFFAIRS; AND 
BRADLEY MAYES, DIRECTOR, COMPENSATION AND PENSION 
SERVICE, VETERANS BENEFITS ADMINISTRATION, U.S. DE- 
PARTMENT OF VETERANS AFFAIRS 

Mr. Walcoff. Thank you, Mr. Chairman. 

Actually, I did have an oral statement that was derived from my 
written statement, but instead I think because the written state- 
ment is part of the record, I would like to use this time just to ad- 
dress some of the issues that were raised by the previous panels. 
Hopefully that will be okay. 

I want to start with some of the testimony presented by my old 
friend, Mr. Abrams. And in his testimony, he talked about what he 
saw as an emphasis within VBA on productivity at the expense of 
quality. And he said that he has seen that and heard that from em- 
ployees who work within VBA. 
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What I would like to offer concerning that is the objective criteria 
that we actually use to evaluate our employees and our managers, 
and I will give you three instances to refute what Mr. Abrams said. 

First of all, in our Directors’ performance standards, we have in 
their standards equal elements for both productivity and quality. 
They are weighted exactly the same. 

In our employees’ performance standards, again we have two ele- 
ments, two of the elements are productivity and quality, again 
weighted exactly the same. 

And in our incentive award criteria, we go a step further. In that 
criteria, in order for a station to qualify for what we call level two 
money, they have to meet a variety of factors and normally we will 
list, say, five or six factors and say you have to meet four of them. 

But in addition to the four of the six factors, they have to meet 
all of their quality factors. That is one that never can be waived. 
Always have to meet quality. And I think that gives an indication 
of the fact that we do put a lot of value on quality, certainly as 
compared to productivity. 

Another statement Mr. Abrams made had to do with work sent 
back from the Board. And he said that 50 percent, over 50 percent 
of work that is sent to the Board comes back to the VA as incorrect. 

I will tell you that is basically a totally false statement. The re- 
mands, as he was referring to, the actual avoidable remand rate, 
meaning cases that go back to the ROs because of mistakes made 
by those Regional Offices is 18 percent. 

Now, I am not saying 18 percent is something that is, you know, 
as good as we would like it to be, but it is a far cry from over 50 
percent. And I wanted to clarify that on the record. 

Mr. Chairman, in your opening statement and then in questions 
with Dr. Keenan, you talked about certification and said that you 
had been told that over 50 percent of the Rating Specialists, 
RVSRs, who took the certification test failed it. 

And I wanted to clarify that. The actual pass rate on the one 
RVSR certification test that we have given is 85 percent. What you 
were referring to is the pass rate on the VSR test which was at 
49 percent. 

And what I would say to you is that you have to understand that 
the VSR certification test measures the employee’s ability to move 
into the senior technical position in authorization, which is what a 
VSR does. 

The person who gets that position has to be at a point where 
they can authorize the work of other employees. We do not believe 
that every employee necessarily will get to the point where they 
can authorize the work of other employees. 

So, frankly, 50 percent as a pass rate did not surprise us and I 
do not believe there is anything wrong with that. The 85 percent 
on Rating Specialists is different because that is a test that meas- 
ures basic knowledge of rating skills. So I would expect the pass 
rate to be higher in that and, of course, it was. 

I want to address something that Dr. Keenan said where she 
talked about the desire that Rating Specialists should have an 
extra 3 weeks of training in predetermination. 

Normally in ideal circumstances, we promote people to the Rat- 
ing Specialist from the VSR position where they have been doing 
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that development work throughout their career. So it is really not 
necessary to do additional training. 

Because of the unusual circumstance that we have been going 
through over the last year and a half where we were hiring so 
many people, bringing most of them in as VSRs, we were put in 
a position where we really could not promote the number of Rating 
Specialists that we would need to do the work that is being devel- 
oped by these new VSRs all from the VSR position because then 
we would be left with no experienced VSRs and we wound up hav- 
ing to hire some Rating Specialists off the street. 

And they are the people that she is talking about that should 
spend some time in predetermination. That is a very small percent- 
age of the total Rating Specialists that we hire, but I think her 
point is well taken and it is something that we will definitely look 
at. 

There are three points that I wanted to make just addressing 
some of the previous remarks. And at this point, I will turn it over 
and say I will be very willing to 

Mr. Hall. Even though the light is red, you are the guy that we 
are here to hear from, so feel free to continue. 

Mr. Walcoff [continuing]. Okay. Then let me address one other 
thing that you had mentioned and that was that employees should 
get credit for training. 

And, in effect, they do get credit for training in that when we 
measure their productivity during the day, they get excluded time 
for any time that they are in training. So that does not count 
against them. If anything, it makes it so that the ratio of hours 
available for work and the work they do is equal so that they do 
not get penalized for being in training. And I think that is an im- 
portant point. 

But at this point, I think I would like to end my statement and 
be available to answer any questions you have. 

[The prepared statement of Mr. Walcoff appears on p. 68.] 

Mr. Hall. Thank you, Mr. Walcoff. 

Mr. Lamborn is double booked for most of this day, so we are 
going to let him go first, the Ranking Member, Mr. Lamborn. 

Mr. Lamborn. Thank you, Mr. Chairman. 

At this point, I will just defer to you because I do not have any 
questions. 

You have done a good job in your written testimony and I will 
be looking that over further. And I will submit further questions 
to you if any arise. Thank you. 

Mr. Walcoff. Thank you, sir. 

Mr. Hall. Thank you, Mr. Lamborn. 

Mr. Walcoff, we talked earlier with one of the panelists about 
getting 80 hours of training and what happens to an employee who 
does not complete it. 

Could you answer that same question? What does VA do about 
employees who do not complete their training? Are there incentives 
to complete it and are there any penalties to not completing it? 

Mr. Walcoff. Let me answer that by saying that I agree with 
the statement that was made by Mr. Ratajczak on the second panel 
that I do not believe that it should be the responsibility of the em- 
ployee to complete the training. I think it is management’s respon- 
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sibility to make sure that all their employees complete the training 
because, frankly, an employee is not going to go up to the manager 
and say, oh, I am leaving my desk now to go sit in on training and 
I will be back in an hour. The manager has to be the one to orches- 
trate that. 

So the person that should be held responsible for employees 
meeting their training are the managers. And I will tell you that 
we have an element in the Directors’ performance standards and 
it is in most of the coaches’ standards that talks about, and it is 
in the Human Resource responsibilities, I believe, it is named a 
critical element, and it talks about the fact that the manager is re- 
sponsible for doing a bunch of different things involving Human 
Resources (HR), one of which is making sure that training is done. 

But I will tell you that in reviewing that and, frankly, in review- 
ing it in preparation for this hearing, I spoke with the Associate 
Deputy Under Secretary for Field Operations and discussed with 
her the need to probably make this a little more specific and make 
it so that we have in there very specifically that our managers will 
be responsible for making sure that all their employees complete 
the number of hours for that position that is required because the 
requirement we currently have, while I think it is specific enough, 
I think that a third party might say, well, it is too generous. So 
we are going to make it even more specific because we do believe 
that somebody should be responsible for that and it should be the 
managers. 

Mr. Hall. Well, that makes sense and I am happy to hear it. 

In your testimony, you mentioned that last year, you trained 
2,150 new VSRs and RVSRs. What percentage of your rating work- 
force does that represent approximately? 

Mr. Walcoff. Well, the 2,100 is Rating Specialists and VSRs. 

Mr. Hall. Right. 

Mr. Walcoff. I mean, I can tell you that we have about 1,800 
Rating Specialists and we have somewhere around 4,500 VSRs. 
But, of course, some of those are people that have been there for 
many, many years. And the numbers you are referring to are just 
the people that went through the challenge training during this 
year. 

So it is kind of tough. It is a hundred percent of the new employ- 
ees that we hired is what I would say. You know, I know I am not 
answering your specific question, but challenge is really geared to 
new employees and every employee must go to challenge training. 

Ms. Mackay. We can indicate that fiscal year 2008, 727 of the 
2,000 or 2,200 people that we have trained in centralized training 
were RVSRs. So that gives you an indication of what percent they 
represent of the workforce. 

Mr. Hall. Mr. Walcoff, you noted that VBA did training with an 
independent consultant to evaluate the challenge training. 

What were the results of that? You contracted with an inde- 
pendent consultant. What were the results of that study? 

Mr. Walcoff. I am going to ask Ms. Mackay to answer that. 

Ms. Mackay. Yes. I do want to make the point that we have ac- 
tually done evaluation on a number of different programs. In fact, 
we have done two different evaluations of the TPSS program. As 
GAO noted, one of those was in 2007 and one was in 2008. 



24 


We also reviewed the Challenge program. Some of the rec- 
ommendations that have come out of that and the point that was 
made was that it does provide value to the organization, that the 
program itself is providing value to the organization. 

There were some recommendations about resequencing some of 
the training modules. Right now there are many that are done on 
the post end of Challenge training, if you will, and we want to 
move some of them to the beginning so that there is less duplica- 
tion. 

The TPSS modules are done on the tail end of Challenge training 
at home station training. Those are very explicit with tests at the 
end of them. 

In the Challenge centralized training, there is some repetition of 
some of the learning that is taking place, so we want to move some 
of those modules forward. 

Those were some of the results that came out of the Challenge 
evaluation. It is a good program. The employees like it. We got ex- 
cellent results. Of the three studies that we did, two on TPSS and 
one on Challenge. We have data from 37 ROs. We did 470 inter- 
views and we interviewed through survey, survey response 2,700 
employees. 

So we really got a very representative sample of the population 
out there including, you know, subject matter experts and bar- 
gaining unit employees in the field. 

Mr. Hall. Has the VA also conducted a time and motion study? 

Mr. Walcoff. I am going to ask Brad to answer that. 

Mr. Mayes. Yes, we have. We conducted one in fiscal year 2007, 
I think, was the last time a motion study was conducted. 

Mr. Hall. And any results you would care to share with us? 

Mr. Mayes. Well, what we do with information that we get from 
the time and motion study is we determine if the weights are ap- 
propriate for the end products that we use for performance man- 
agement. In other words, how many hours does it take to do an 
original compensation claim, how many hours does it take to do a 
reopened compensation claim or a Dependency and Indemnity 
Compensation (DIC) claim. And then those end products as employ- 
ees work those types of cases, they get work credit, the station gets 
credit. Ultimately that is used for resource allocation as well. 

So there were some adjustments made to the work credits based 
on that study. But off the top of my head, I do not remember ex- 
actly what the 

Mr. Hall. Would you please send the Subcommittee the study? 
It is something we would like to have a look at and save you from 
having to tell us or remember all the details of it. 

Mr. Mayes, how long can an employee be on a performance im- 
provement plan? 

Mr. Mayes [continuing]. Well, the 

Mr. Walcoff. Yeah. If you do not mind, I will answer that. I am 
a former HR guy, so I have knowledge of that. 

The performance improvement plan (PIP) as laid out in our nego- 
tiated agreement is 90 days. And they have 90 days during which 
they meet regularly with their supervisor. They get counseling ses- 
sions in terms of how they are doing. We ask them what help do 
you need in order to meet your performance standards. Is there 
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training you need. Is there any particular information that you 
need. And then they are evaluated at the end of the 90 days and 
then a decision is made on whether they should be kept in their 
position or removed from their position. 

Mr. Hall. So if the employee improves, but then does not 
achieve the fully successful rating on their evaluation, do you do 
another improvement plan or just move them to a different position 
or move them? 

Mr. Walcoff. There are situations where an employee will be 
not meeting their standards. They go on a PIP. They meet their 
standards. They go off the PIP. They do not meet their standards 
and then you put them on another PIP. 

The case law actually in that situation says that if that happens 
a number of times, and it is undefined what the number is, that 
you may actually be looking at a conduct problem rather than a 
performance problem. It is something that occasionally we run into. 

Most of the time when employees are on a PIP, hopefully we are 
able to give them the assistance and the tutoring that they need 
so that they can become satisfactory in their jobs and never be on 
a PIP again. 

Mr. Hall. Is the ASPEN system, which tracks employee per- 
formance, integrated with the STAR Quality Review Program and 
how is that information cross-referenced? 

Mr. Walcoff. The ASPEN system is merely just a shell that we 
use for tracking. You know, we have to do quality control, perform- 
ance evaluations of individuals because that is part of their per- 
formance standards. We needed some vehicle to track that. 

In other words, if we are looking at Dorothy Mackay as an em- 
ployee, how many cases did she do this month, how many were cor- 
rect, and be able to track that over a year. That is all that Aspen 
is. 

The quality assurance program that is STAR is a totally separate 
program. They are not connected in any way other than one meas- 
ures quality of an individual whereas the quality assurance pro- 
gram, the STAR Program measures quality for the organization. 

Mr. Hall. The primary goal of training obviously is to improve 
the accuracy of the rating decisions. However, there are still accu- 
racy issues at many ROs. 

Should there be additional training in those offices and are those 
employees still eligible for bonuses and promotions even if the of- 
fice’s accuracy rate is below the national standard? 

Mr. Walcoff. Let me answer the second part of the question in 
terms of the bonuses. As I had mentioned earlier, the level two 
awards, which are the primary source of bonuses for employees, is 
dependent on the station performance and quality. So if a station 
is not making quality, that station will not get level two money 
that they could give to those employees. 

There is something called level one which is a smaller amount 
of money that every station gets for their own use. And if you hap- 
pen to have an individual in a C&P, in a service center who is an 
outstanding employee, whose individual work is outstanding, even 
though the work of that division is not outstanding, you have at 
least that level one money where you can reward that individual. 
So 
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Mr. Hall. Management discretion? 

Mr. Walcoff [continuing]. Right. Exactly. 

Mr. Hall. I want to ask Ms. Mackay how many actual days of 
training do you provide at the Academy? Do trainees have to sign 
in and out every day and how do you track their participation? 

Ms. Mackay. I assume we are talking about the Challenge stu- 
dents related to C&P training because we do do training at the 
Academy as well. 

It is 3 weeks of training. And I noted in DAV’s testimony that 
they thought that the travel time really cut into the 3 weeks of 
training. These are bargaining unit employees, so we do have to 
pay attention to the fact that, you know, we do not want them trav- 
eling on the weekend. But we only cut one and a half days off of 
that 3 weeks. So it is 1 day on the front end and then a half day 
on the back end. 

So it is, you know, virtually 3 weeks long of training. And they 
are there. There is an accountability. There are instructors there 
along with a course manager. So any coming and going of students 
during that 3 weeks of centralized training is duly noted. 

It is only for emergency purposes. We have had some folks who 
might have gotten sick or whatever. They are monitored. And not 
only are they monitored in terms of their health and getting them 
back in the classroom, but there is a communication with the Re- 
gional Office that they have been removed from the classroom for 
whatever reason. So that notification is made to the RO as well. 

So we keep a good track of the students when they are at the 
Academy for that 3 weeks of training. 

Mr. Hall. What is the pass/fail rate at the Baltimore Academy? 

Ms. Mackay. In terms of? 

Mr. Hall. The employees you train. 

Ms. Mackay. Well, if they go through the modules and the train- 
ing, the 3 weeks of training, there is not any graduation per se of 
them. There is enforcement every single day. 

Again, whenever you have a classroom full of students with vary- 
ing levels of ability, it is the job of the instructors to really assess 
that classroom and see whether they need to pay particular atten- 
tion and give special effort and interest to particular students, that 
they get it before they leave the classroom, that particular lesson. 

So in that sense, they do or should when they leave the Academy 
have learned the modules and the lessons that they need in order 
to go back and do the post training at their station. 

Mr. Hall. If we could just talk about the training manual, the 
five volume training manual for a second. It seems like it may not 
be the most effective tool. 

Have you consulted with the private-sector organizations that 
specialize in developing training protocols or Federal and private- 
sector agencies? 

Ms. Mackay. I think I am going to pass that to Mr. Mayes. 

Mr. Mayes. I am not familiar with the five volume training man- 
ual. I think you might be talking about what we call our Manual 
of Adjudication Procedures. We call it 11MR right now. It should 
just be M21-1. We had rewritten the manual a couple of years ago 
and completed it. It is a number of volumes. 



27 


The way I look at the manual is that we start with statute and 
regulations and sometimes, as you know, some of these statutes 
and regulations are rather difficult to apply or understand or inter- 
pret at the Regional Office level. 

So the manual then takes those procedures or those regulations 
and interprets those in a more, I would call it, a more straight- 
forward fashion so that our VSRs and our RVSRs in the field have 
a ready reference to apply the laws and regulations properly. 

And it is complex. When we did the task analysis for our VSRs 
a number of years ago, actually, Admiral Cooper noted this, and 
they were working with the Claims Commission, there is some- 
thing on the order of 11,000 tasks. It is complex work and it does 
take a lot of rules to make sure that we comply with the law. 

Mr. Hall. We have been known to write some complicated and 
challenging laws. 

Mr. Mayes. I was not referring to any of your legislation. 

Mr. Hall. We held a roundtable with survivors back in the 
spring. At that time, we heard tales of folks who have encountered 
VBA employees who did not seem to know much about survivors’ 
benefits such as DIC. 

Do you do specialized training around those issues? 

Mr. Mayes. Well, training on the Dependency and Indemnity 
Compensation benefit is part of the training curriculum for our 
new VSRs. So, yes, that is included in that curriculum. 

And that curriculum, by the way, requires 26 weeks. So the for- 
mal curriculum, 26 weeks. It is two to 3 weeks of prerequisite 
training. Then we send our VSRs off to Challenge where they have 
another 3 weeks of formal training. We utilize the TPSS modules, 
the training, performance, support system modules in this training 
and then they go back to the Regional Office. 

And it is a combination, as the gentleman from GAO said, it is 
a combination of computer-based training and then moving away 
from that and practically applying it. And DIC is part of that proc- 
ess, that curriculum. 

Mr. Hall. Thank you. 

Now, Mr. Walcoff, I want to ask you a couple more questions 
here. 

VHA has had success with teleconferencing capabilities. I am cu- 
rious if VBA has sought out the same opportunities to train with 
teleconferencing. 

Mr. Walcoff. I am looking at Dorothy to see whether we actu- 
ally use teleconferencing for training. 

Ms. Mackay. Yes. 

Mr. Mayes. I can tell you most recently, we identified in the field 
some challenges applying the DeLuca rules. In other words, a court 
case a number of years ago that said that when there is limitation 
resulting — when pain results in limitation of function or motion, 
that we can adjust the evaluation commensurately. 

And so what we did recently was we had a national conference 
call that was targeted at our Rating Veteran Service Representa- 
tives. We identified this through our quality assurance program. So 
when we find through our quality assurance program that we have 
a targeted area that needs focus, then frequently we will have a 
teleconference with RVSRs or managers out in the field. 
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And we are doing that right now as part of our followup from the 
findings on STAR. We are doing that monthly with the Regional 
Office. So there is an example where we would use conference calls 
to initiate discussion on topics that are causing some problems in 
the field. 

Mr. Hall. You know, that is obviously a developing and more 
frequently used tool that you may find yourselves wanting to use 
more. 

I want to also ask what training is required of Board of Veterans’ 
Appeals employees. 

Mr. Walcoff. Well, you know, that is something that we are not 
really involved in. I mean, BVA has their own training programs 
for their employees and I do not think any of us are in a position 
to be able to answer that. 

Mr. Hall. Then we will not ask you that question then. 

So the Subcommittee staff recently conducted a site visit to Oki- 
nawa, Guam, and Hawaii to review the claims processing issues 
there. And a point that was brought up in Japan was the role of 
the U.S. State Department in compiling claims information for the 
Islands of Micronesia, Palau, and the Marshall Islands. The De- 
partment of the Interior handles veterans’ claims. 

How does VA inform other agencies and train them in the claims 
application process and educate them on other benefits informa- 
tion? 

Mr. Walcoff. That is going to be yours again. 

Mr. Mayes. Well, we do work with representatives from the 
State Department who are involved in communicating information 
about veterans’ benefits. We recently had a training seminar. Mem- 
bers of the Compensation and Pension Service staff conducted that 
training. So we are involved in that. 

Primarily what we have State Department personnel doing is 
again giving out information and also they are involved in the co- 
ordination of compensation and pension exams for veterans who re- 
side overseas. So we give them information and provide training for 
that as well. 

Mr. Hall. Okay. Lastly, I wanted to ask a question about dose 
reconstruction. The Veterans’ Advisory Board on Dose Reconstruc- 
tion met this month and discussed the advantages of having the 
specialization and ionizing radiation claims in one RO so the train- 
ing could be targeted. 

If this is true for atomic veterans’ claims, would specialization 
and targeted training benefit veterans with other conditions such 
as Post Traumatic Stress Disorder (PTSD) or Traumatic Brain In- 
jury (TBI)? 

Mr. Walcoff. I think that the idea of specializing in that sense 
is something that we have had a lot of discussion about. 

And at this point, the problem is that when somebody, for in- 
stance, files a claim for PTSD, invariably there are going to be 
other issues that they are also claiming. And it is very difficult to 
send just the PTSD part of a file, you know, to another office and 
say you work on that and we will leave everything else at the home 
office because everybody needs access to the entire file. 

What we do believe is as we move, I hope steadily, toward get- 
ting to the point where we go paperless and we have electronic 
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files, one of the real advantages of that will be that if we want a 
particular office to, say, do the PTSD part of the claim, they will 
be able to access the file the same time as the home office is access- 
ing the file because it is electronic. And that really would make it 
so that we would be able to do that type of specialization on a more 
frequent basis. 

The radiation claims are so complex and there are so few of them 
that we felt that it made sense to do it even with the fact that we 
are in paper. But ultimately I believe that when we go paperless, 
it will open all kinds of doors for us exactly as you are talking. 

Mr. Hall. You are a moving target, as you know, and in our 
oversight capability or legislative capability, we are trying to en- 
courage or fund or to help you move in directions that you are al- 
ready moving in many circumstances. 

So you just brought up the paperless thing. I want to ask you 
how that is going. I know even though our bill has passed the 
House, we are waiting for Senate action, which hopefully we will 
see. But at the same time, I am sure you are somewhere down the 
road. 

Any reports on that? 

Mr. Walcoff. There are a lot of things that are happening. The 
biggest thing right now is we are awaiting for the awarding of a 
contract for our lead systems integrator, which is going to be a very 
key piece as we move forward because the integrator is going to be 
the person that or the organization that works with us in coordi- 
nating all the different parts of this, you know, project that we call 
paperless, you know, including the part that deals with a veteran’s 
ability to apply online for benefits, including the ability for a vet- 
eran to go into our system and be able to determine the status of 
his claim without having to pick up the phone and call us, includ- 
ing the part about making all the actual paper electronic. 

There are so many pieces to this and the integrator is going to 
be a key player. That contract is supposed to be awarded before the 
end of the fiscal year. So that is a major, major step forward with 
us. So we are very, very optimistic in terms of the future. 

The Secretary, I will tell you, Mr. Chairman, the Secretary has 
been relentless in terms of telling us that we will be paperless. So 
we are absolutely getting a lot of encouragement. 

Mr. Hall. In terms of your continuing efforts to do the things 
that we are trying to tell you to do or ask you to do, is there any 
report or progress? Have you been working on updating the rating 
schedule at the same time? 

Mr. Walcoff. Brad, you want 

Mr. Mayes. Yes. I do not know if you saw the press release. I 
think it came out yesterday or the day before. But we are creating 
a Federal Advisory Committee that will be tasked with taking a 
look at the schedule, looking at the studies that have been done re- 
cently. 

And we have the Marsh-West study. We have the Disability Ben- 
efits or Veterans Disability Benefits Commission, the Dole-Shalala 
Commission. There are a lot of folks out here that have done some 
work and looked at it. 
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And, of course, I think you know that we have contracted with 
a firm to review the aspects of the Dole-Shalala proposed legisla- 
tion that the President sent over to Congress. 

So this Advisory Committee will be looking at all of that and 
then making recommendations to the Secretary on, I would say, 
how do we get moving and prioritize and what is next. 

And, finally, I want to mention to you that we had proposed a 
new rule for traumatic brain injury. We think that is going to go 
final very quickly. It is going to change the rating criteria for TBI. 
We just updated the skin portion that was proposed. We think we 
are close to going final on that. And we are working on adding pre- 
sumptive for Amyotrophic Lateral Sclerosis (ALS). 

Mr. Hall. And this is really the last question now. Where do you 
stand with the quality of life study? 

Mr. Mayes. Well, that is the study that I just mentioned. We are 
in the process of going through it. Our technical comments have 
been requested. So as we move through that and provide that feed- 
back to the contractor. Once that is complete, then it will be pub- 
lished and available to the Committee. 

Mr. Hall. Great. We look forward to receiving that. 

Thank you all for your statements, for your answers, for the 
work you do for our veterans. 

And I would like to thank everybody from all the previous panels 
for your insight and opinions. 

And this hearing now stands adjourned. 

[Whereupon, 11:45 a.m., the Subcommittee was adjourned.] 
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Prepared Statement of Hon. John J. Hall, Chairman, 
Subcommittee on Disability Assistance and Memorial Affairs 

Our Nation’s veterans understand the necessity of proper and adequate training — 
their lives have depended on it. The military trains for its operations and everyone 
knows every detail of their job prior to the mission. These same veterans should be 
able to expect the same level of competence when they seek assistance from the Vet- 
erans Benefits Administration. Unfortunately, that is not the case, as we have 
heard at other meetings and hearings throughout the year that this Subcommittee 
has held regarding the VA disability claims processing system. 

VA has standardized its training curriculum and requires that all claims proc- 
essors must complete 80 hours of annual training. This is a lot of hours because 
in fact some healthcare providers don’t need to meet that level of continuing edu- 
cation to maintain their clinical license or credentialing. 

The VBA training topics are identified by Central Office or by the individual’s Re- 
gional Office (RO). New employees go through an orientation process and there are 
additional online learning tools available through the VBA’s Training and Perform- 
ance Support System. 

Yet, with all of this effort, VA training seems to be falling short of its intended 
goals. Less than 50 percent of the Ratings Veterans Service Representatives 
(RVSRs) passed the certification exam, even though it was an open-book test. But, 
frankly, I’ve seen the training manual and it can be measured in pounds not pages, 
so I don’t know how useful their book is and that can be the crux of the matter 
right there. More importantly, as outlined in previous hearings, there are significant 
inconsistencies in ratings between VA’s 57 ROs and a high rate of remanded cases. 

I am pleased that the AFGE is here to shed light on this issue. You are a critical 
link to those on the frontlines working to improve outcomes for our disabled vet- 
erans. 

The Government Accountability Office (GAO) released a report in May 2008 enti- 
tled, “Veterans’ Benefits: Increased Focus on Evaluation and Accountability Would 
Enhance Training and Performance Management for Claims Processors” that docu- 
mented the areas in which VA needs to improve its training and hold accountable 
those it does train. 

According to the GAO, staff is not held accountable for completing the required 
training, since VBA does not track completion, so there are no consequences for not 
taking the training. Additionally, VBA does not evaluate its training, so it does not 
know if it has successfully designed and implemented an educational program. 
Feedback is not consistently collected from RO employees on the training that they 
do receive and many have reported difficulty in accessing training because of their 
stringent productivity demands. I look forward to hearing more from the GAO about 
this report. 

But, these are not surprising conclusions to the Veterans Service Organizations, 
which have complained for years about the inadequacies of the VBA training pro- 
gram. So, I am grateful that they have joined us here today as well. 

Training is not an issue that should be taken lightly. We all know the importance 
of good training, but effective implementation that ensures consistency and account- 
ability can be elusive and that is what I hope we can address today. I have taken 
steps to ensure improved training outcomes when I introduced the ‘Veterans Dis- 
ability Benefits Claims Modernization Act”, H.R. 5892. These policy enhancements 
will lead to compensation claims processing improvements and more accurate claims 
adjudication results for our veterans and their families. Moreover, I am not sure 
that VBA’s current training regimen complements its current Claims Processing Im- 
provement model, or CPI. In fact, I am positive that the current coupling detracts 
from increased accountability efforts. 

I am pleased to report, with the help of many in this room, H.R. 5892 passed the 
House on July 31, 2008, by a 429 to 0 vote. On August 1, 2008, Senator Clinton 
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introduced companion legislation to my bill, S. 3419. So, Congress is well on its way 
to rectifying the inadequacies in the VBA that have already been identified to us. 

Today’s oversight hearing will allow us to drill deeper into this issue and gauge 
where VA is at in its training protocol and see where other improvements can still 
be made. I look forward to hearing from our witnesses today and hope to learn more 
about best practices and strategies for measuring performance and building better 
training protocols and accountability standards. 


Prepared Statement of Hon. Doug Lamborn, Ranking Republican Member, 
Subcommittee on Disability Assistance and Memorial Affairs 

Thank you Chairman Hall for yielding. 

I am pleased to have this opportunity for a collective discussion on the effective- 
ness of the Veterans Benefits Administration’s (VBA’s) training, performance man- 
agement, and accountability requirements. 

Over the course of the past several months, this Subcommittee has examined 
nearly every facet of the VA benefits claims processing system in an effort to iden- 
tify how we might help the Department overcome the claims backlog crisis. 

While the recent expansion of its workforce will certainly have a positive impact, 
VA must ensure that newly hired claims workers receive training that is commensu- 
rate with their responsibilities. 

It is critical that the training it provides meets the needs of the Department and 
its employees. 

It is equally important that the results of the training are evaluated. Without 
feedback, VA may never know whether or not the training is accomplishing its goal. 

Any viable training program should be able to identify deficiencies and dem- 
onstrate the intended and actual outcome of its curriculum. 

VA training must be connected to its vision and mission, and VA managers need 
to be assured that if employees are pulled off the floor for training that it will result 
in long-term benefits. 

I’m sure that with a growing number of pending claims, there is a certain level 
of trepidation that, “There’s too much work to do already and we’ll just get further 
behind if we have to conduct training.” 

There must be clear support, from the top down, in order to conduct adequate 
training and acquire the expected outcomes. 

Certainly, training new employees on everything they need to know in order to 
make sound rating decisions is a daunting task. 

The VA rating schedule itself is complex and it’s merely a portion of the array 
of knowledge a competent adjudicator must possess to perform his or her job. 

I view today’s hearing as an opportunity to not only learn more about the training 
and assessment program VA provides its employees, but also to reiterate to the De- 
partment that it should be forthright about any additional resources deemed nec- 
essary to fulfill this critical requirement. 

I look forward to our witnesses’ testimony and a productive discussion on VA’s 
training program. 

I yield back. 


Prepared Statement of Daniel Bertoni, Director, Education, Workforce, and 
Income Security Issues, U.S. Government Accountability Office 

Improvements Needed in VA’s Training and 
Performance Management Systems 

GAO Highlights 

Why GAO Did This Study 

The Department of Veterans Affairs’ (VA) disability claims process has long been 
a subject of concern because of long waits for decisions and large backlogs of claims 
pending decisions. To address these issues, VA has hired almost 3,000 new claims 
processors since January 2007. However, adequate training and performance man- 
agement are essential to developing highly competent disability claims processors 
and ensuring that experienced staff maintain the skills needed to issue timely, accu- 
rate, and consistent decisions. 



33 


The Subcommittee on Disability Assistance and Memorial Affairs, House Vet- 
erans’ Affairs Committee asked GAO to present its views on (1) VA’s training for 
its claims processors, and (2) VA’s performance management of this staff. This state- 
ment is based on a May 2008 report on VA’s training and performance management 
(GAO-08-561) and has been updated as appropriate. 

What GAO Recommends 

In its May report, GAO recommended that VA collect feedback from staff on the 
training provided in the regional offices and use this feedback to improve training; 
hold staff accountable for meeting their training requirement; and assess, and if 
necessary adjust its process for placing staff in overall performance categories. VA 
concurred with these recommendations, but has not yet reported any significant 
progress in implementing them. 

What GAO Found 

Training for VA disability claims processors complies with some accepted training 
practices, but VA does not adequately evaluate its training and may have opportuni- 
ties to improve training design and implementation. VA has a highly structured, 
three-phase training program for new staff and an SO-hour annual training require- 
ment for all staff. GAO found that VA has taken steps to plan this training strategi- 
cally and that its training program for new staff appears well-designed and con- 
forms to adult learning principles. However, while VA collects some feedback on 
training for new staff, it does not collect feedback on all the training conducted at 
its regional offices. Moreover, both new and experienced staff reported problems 
with their training. Some new staff told us a computer-based learning tool is too 
theoretical and often out of date. 

More experienced staff said they struggled to meet the annual SO-hour training 
requirement because of workload pressures or could not always find courses rel- 
evant given their experience level. Finally, the agency does not hold claims proc- 
essors accountable for meeting the annual training requirement. 

VA’s performance management system for claims processing staff generally con- 
forms to accepted practices. For example, individual performance measures, such as 
quality and productivity, are aligned with the agency’s organizational performance 
measures, and VA provides staff with regular performance feedback. However, the 
system may not clearly differentiate among staff performance levels. In each of the 
regional offices we visited, at least 90 percent of claims processors were placed in 
just two of five overall performance categories. Broad, overlapping performance cat- 
egories may deprive managers of the information they need to reward top per- 
formers and address performance issues, as well as deprive staff of the feedback 
they need to improve. 

Fiscal Year 2007 Appraisals for Four Offices 
Were Concentrated in Two Categories 
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Mr. Chairman and Members of the Subcommittee: 

I am pleased to have the opportunity to comment on training and performance 
management for Department of Veterans Affairs’ (VA) disability claims processors. 
In fiscal year 2007, VA paid about $37V2 billion in benefits to more than 3.6 million 
veterans and their families. The disability claims process has long been a subject 
of concern for VA, the Congress, and veterans’ service organizations due to long 
waits for decisions, large backlogs of pending claims, and problems with the accu- 
racy and consistency of decisions. Moreover, we have noted that VA’s current dis- 
ability process is in urgent need of re-examination and transformation, especially in 
regard to how it assesses the work capacity of individuals with disabilities in today’s 
world and in its ability to provide timely and appropriate benefits. With an increase 
in claims resulting from injuries sustained in Iraq and Afghanistan and from an 
aging veteran population, these issues will likely persist. To address them, VA 
added almost 3,000 new claims processors from January 2007 to July 2008 and has 
plans to add even more staff by the end of September 2008. Earlier this year, I testi- 
fied before this Subcommittee that enlarging VA’s disability workforce is likely to 
produce certain human capital challenges for the agency. 1 More staff alone will not 
guarantee effective disability claims processing. Among other things, adequate 
training and performance management are essential to developing highly competent 
new disability claims processors and ensuring that experienced staff maintain the 
skills needed to issue timely, accurate, and consistent disability decisions. 

My remarks today primarily draw from our May 2008 report for the Committee 
on Veterans’ Affairs and focus on (1) VA’s training for its disability claims proc- 
essing staff and (2) its performance management system for claims processors. We 
conducted our work in accordance with generally accepted Government auditing 
standards. 2 For this testimony, we updated information from our report, as appro- 
priate, to reflect the current status of VA training and performance management 
systems. 

In summary, although we found that training for VA disability claims processors 
complies with some accepted training practices, it is not adequately evaluated, and 
some aspects of training design and implementation could be improved. We found 
that VA has taken steps to strategically plan its training, including the establish- 
ment of a training board to evaluate the agency’s training needs. Also, VA’s training 
program for new staff appears well-designed and conforms with adult learning prin- 
ciples. However, while VA collects feedback on many of the training methods and 
tools for new staff, not all the training VA conducts is evaluated to determine how 
relevant or effective it is. Moreover, both new and experienced staff reported prob- 
lems with their training. Some new staff members reported that a computer-based 
learning tool was not useful. Also, VA requires 80 hours of training annually for all 
claims processors, but some experienced claims processors struggled to meet this re- 
quirement because of workload pressures, and some could not always find relevant 
courses. It is not clear what criteria VA uses to justify the number of required train- 
ing hours. Furthermore, individual claims processors are not held accountable for 
meeting the annual training requirement, although according to VA, the agency has 
implemented a new learning management system allowing it to monitor staffs com- 
pletion of the training requirement. 

VA’s performance management system for claims processing staff generally con- 
forms to accepted performance management practices. For example, individual per- 
formance measures, such as quality and productivity, are aligned with the agency’s 
organizational performance measures, and VA provides claims processing staff with 
regular feedback on their performance. However, the system may not clearly dif- 
ferentiate among performance levels. Broad, overlapping performance categories 
may deprive managers of the information they need to reward top performers and 
address performance issues, as well as deprive staff of the feedback they need to 
improve. 

Background 

The Veterans Benefits Administration (VEA) within VA administers the disability 
compensation and pension programs, whereby VA claims processing staff assess vet- 
erans’ applications for disability compensation and pension benefits. Aside from ben- 
efits for veterans, VEA claims processing staff make eligibility determinations for 
deceased veterans’ spouses, children, and parents. In short, they are responsible for 


1 GAO, Veterans’ Disability Benefits: Claims Processing Challenges Persist, While VA Con- 
tinues to Take Steps to Address Them, GAO-08-473T (Washington, DC: Feb. 14, 2008). 

2 GAO, Veterans’ Benefits: Increased Focus on Evaluation and Accountability Would Enhance 
Training and Performance Management for Claims Processors, GAO— 08-561 (Washington, DC: 
May 27, 2008). 
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ensuring that the decisions that lead to paying disability compensation and pension 
benefits are timely, accurate, and consistent. 

The VA disability claims process involves multiple steps and usually involves 
more than one claims processor. When a veteran submits a claim to one of VEA’s 
57 regional offices, staff in that office are responsible for obtaining evidence to 
evaluate the claim, such as medical and military service records; determining 
whether the claimant is eligible for benefits; and assigning a disability rating speci- 
fying the severity of each of the veteran’s impairments. These ratings determine the 
amount of benefits eligible veterans will receive. 

VA has faced questions about the timeliness, accuracy, and consistency of its dis- 
ability decisions. GAO designated Federal disability programs, including VA and 
other programs, as a high-risk area in 2003. In particular, our prior work found VA 
relied on outmoded criteria for determining program eligibility that did not fully re- 
flect advances in medicine and technology or changes in the labor market. As a re- 
sult, VA’s disability program may not recognize an individual’s full potential to 
work. In addition, VA has seen processing times for their disability claims increase 
over the past several years, and inconsistencies in disability decisions across loca- 
tions have raised questions about fairness and integrity. 

Some have suggested that VA needs to address its training and guidance related 
to claims processing in order to improve consistency and that it should conduct peri- 
odic evaluations of decisions to ensure the accuracy of ratings across disability cat- 
egories and regions. VA has reported that some of the inconsistency in its decisions 
is due to complex claims, such as those involving post-traumatic stress disorder, but 
it has also acknowledged that the accuracy and consistency of claims decisions needs 
further improvement. 

Training Complies With Some Accepted Practices, But VBA Does Not Ade- 
quately Evaluate Training and May Be Falling Short in Training Design 
and Implementation 

To prepare newly hired staff to perform the tasks associated with processing dis- 
ability claims, VEA has developed a highly structured, three-phase program de- 
signed to deliver standardized training. The first phase is designed to lay the foun- 
dation for future training by introducing new staff to topics such as medical termi- 
nology and the computer applications used to process and track claims. The second 
provides an overview of the technical aspects of claims processing, including records 
management, how to review medical records, and how to interpret a medical exam. 
The third includes a combination of classroom, on-the-job, and computer-based 
trainings. The second and third phases in this program are designed to both intro- 
duce new material and reinforce material from the previous phase. 

To help ensure that claims processing staff continually maintain their knowledge 
after their initial training and keep up with changing policies and procedures, 
VEA’s Compensation and Pension Service requires all claims processing staff to 
complete a minimum of 80 hours of technical training annually. This training re- 
quirement can be met through a mix of classroom instruction, electronic-based train- 
ing from sources such as the Training and Performance Support System (TPSS), or 
guest lecturers. VBA’s regional offices have some flexibility over what courses they 
provide to their staff to help them meet the training requirement. These courses can 
cover such topics as establishing veteran status, asbestos claims development, and 
eye-vision issues. 

We found that VBA has taken some steps to strategically plan its training for 
claims processors in accordance with generally accepted training practices identified 
in our prior work. 3 For example, VBA has taken steps to align training with the 
agency’s mission and goals. In 2004, VBA established an Employee Training and 
Learning Board (board) to, among other things, ensure that the agency’s training 
decisions support its strategic and business plans, goals, and objectives. Also, VBA 
has identified the skills and competencies needed by its claims processing staff by 
developing a decision tree and task analysis of the claims process. In addition, VBA 
has taken steps to determine the appropriate level of investment in training and 
to prioritize funding. The board’s responsibilities include developing an annual 
training budget and recommending training initiatives to the Under Secretary of 
Benefits. Further, we found that VBA’s training program for new claims processing 
staff appears well-designed, in that it conforms to adult learning principles by care- 
fully defining all pertinent terms and concepts and providing abundant and realistic 
examples of claims work. 


3 GAO, Human Capital: A Guide for Assessing Strategic Training and Development Efforts in 
the Federal Government, GAO— 04-546G (Washington, DC: March 2004). 
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However, while VBA has developed a system to collect feedback from new claims 
processing staff on their training, the agency does not consistently collect feedback 
on all of the training it provides. For example, none of the regional offices we visited 
consistently collected feedback on the training they conduct. Without feedback on 
regional office training, VBA may not be aware of how effective all of its training 
tools are. 

Moreover, both new and experienced claims processing staff we interviewed re- 
ported some issues with their training. A number of staff told us the TPSS was dif- 
ficult to use, often out-of-date, and too theoretical. Some claims processing staff with 
more experience reported that they struggled to meet the annual training require- 
ment because of workload pressures or that training topics were not always relevant 
for staff with their level of experience. VBA officials reported that they have re- 
viewed the 80-hour training requirement to determine if it is appropriate, but they 
could not identify the criteria or any analysis that were used to make this deter- 
mination. Identifying the right amount of training is crucial. An overly burdensome 
training requirement may needlessly take staff away from essential claims proc- 
essing duties, while too little training could contribute to processing and quality er- 
rors. 

In addition to lacking a clear process for assessing the appropriateness of the SO- 
hour training requirement, VBA also has no policy outlining consequences for indi- 
vidual staff who do not complete the requirement. Because it does not hold staff ac- 
countable, VBA is missing an opportunity to clearly convey to staff the importance 
of managing their time to meet training requirements, as well as production and 
accuracy goals. In fiscal year 2008, VBA implemented a new learning management 
system that allows it to track the training hours completed by individual staff. Al- 
though VBA now has the capacity to monitor staffs completion of the training re- 
quirement, the agency has not indicated any specific consequences for staff who fail 
to meet the requirement. 

VA’s Performance Management System Generally Conforms With Accepted 
Practices, But May Not Clearly Differentiate Among Staff’s Perform- 
ance Levels 

VA’s performance management system for claims processors is consistent with a 
number of accepted practices for effective performance management systems in the 
public sector. 4 For example, the elements used to evaluate individual claims proc- 
essors-such as quality, productivity, and workload management-appear to be gen- 
erally aligned with VBA’s organizational performance measures. Aligning individual 
and organizational performance measures helps staff see the connection between 
their daily work activities and their organization’s goals and the importance of their 
roles and responsibilities in helping to achieve these goals. VA also requires super- 
visors to provide claims processors with regular feedback on their performance, and 
it has actively involved its employees and other stakeholders in developing its per- 
formance management system. 

However, VA’s system may not be consistent with a key accepted practice-clear 
differentiation among staff performance levels. We have previously reported that, in 
order to provide meaningful distinctions in performance for experienced staff, agen- 
cies should preferably use rating systems with four or five performance categories. 5 
If staff members’ ratings are concentrated in just one or two of multiple categories, 
the system may not be making meaningful distinctions in performance. Systems 
that do not make meaningful distinctions in performance fail to give (1) employees 
the constructive feedback they need to improve and (2) managers the information 
they need to reward top performers and address performance issues. 

VA’s performance appraisal system has the potential to clearly differentiate 
among staff performance levels. Each fiscal year, regional offices give their staff a 
rating on each individual performance element: exceptional, fully successful, or less 
than fully successful. For example, a staff member might be rated exceptional on 
quality, fully successful on productivity, and so forth. Some elements are considered 
critical elements, and some are considered noncritical. Staff members are then as- 
signed to one of five overall performance categories, ranging from unsatisfactory to 
outstanding, based on a formula that converts a staff member’s combination of rat- 
ings on the individual performance elements into an overall performance category 
(see fig. 1). 


4 GAO, Results Oriented Cultures: Creating a Clear Linkage between Individual Performance 
and Organizational Success , GAO-03—488 (Washington, DC: Mar. 14, 2003). 

5 GAO, Human Capital: Preliminary Observations on the Administration’s Draft Proposed 
“ Working for America Act,” GAO-06— 142T (Washington, DC: Oct. 5, 2005). 
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Figure 1 — VA Overall Performance Appraisal Formula 
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Source: GAO analysis of VBA information. 

However, there is evidence to suggest that the performance management system 
for claims processing staff may not clearly or accurately differentiate among staffs 
performance. Central office officials and managers in two of the four regional offices 
we visited said that, under the formula for assigning overall performance categories, 
it is more difficult to place staff in certain overall performance categories than in 
others-even if staffs performance truly does fall within that category. These man- 
agers said it is especially difficult for staff to be placed in the excellent category. 
In fact, at least 90 percent of all claims processors in the regional offices we visited 
ended up in only two of the five performance categories in fiscal year 2007: fully 
successful and outstanding (see fig. 2). 

Figure 2 — Fiscal Year 2007 Overall Performance Ratings 
for Claims Processors in Four Regional Offices Were 
Concentrated in the Outstanding and Fully Successful Categories 
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Some managers told us that there are staff whose performance is better than fully 
successful but not quite outstanding, but that under VA’s formula, it is difficult for 
these staff to be placed in the excellent category. To be placed in the excellent cat- 
egory, a staff member must be rated exceptional in all the critical elements and 
fully successful in at least one noncritical element. However, managers told us that 
virtually all staff who are exceptional in the critical elements are also exceptional 
in the noncritical elements, and they are appropriately placed in the outstanding 
category. On the other hand, if a staff member is rated fully successful on just one 
critical element, even if all other elements are rated as exceptional, the staff mem- 
ber’s overall performance category falls from outstanding to fully successful. 

Neither VBA nor VA central office officials have examined the distribution of 
claims processing staff across the five overall performance categories. However, VA 
has acknowledged that there may be an issue with its formula, and the agency is 
considering changes to its performance management system designed to allow for 
greater differentiation in performance. Absent additional examination of the dis- 
tribution of claims processors among overall performance categories, VA lacks a 
clear picture of whether its system is working as intended and whether any adjust- 
ments are needed. 

In conclusion, VA appears to have recognized the importance of developing and 
maintaining high performing claims processors. It needs to devote more attention, 
however, to ensuring that its training and performance management systems are 
better aligned to equip both new and experienced staff to handle a burgeoning work- 
load. Specifically, in our May 2008 report, we recommended that VA should collect 
feedback from staff on training provided in the regional offices in order to assess 
issues such as the appropriateness of the 80-hour annual training requirement and 
the usefulness of TPSS. We also recommended that the agency should use informa- 
tion from its new learning management system to hold staff members accountable 
for meeting the training requirement. In addition, we recommended that VA should 
assess whether its performance management system is making meaningful distinc- 
tions in performance. In its comments on our May 2008 report, VA concurred with 
our recommendations, but it has not yet reported making any significant progress 
in implementing them. 

While hiring, training, and evaluating the performance of staff is essential, com- 
mensurate attention should be focused on reviewing and aligning disability benefits 
and service outcomes to today’s world. In prior work, we have noted that VA and 
other F ederal disability programs must adopt a more modern understanding of how 
technology and labor market changes determine an individual’s eligibility for bene- 
fits, as well as the timing and portfolio of support services they are provided. To 
the extent progress is made in this area, effective training and performance man- 
agement systems will be of crucial importance. Moreover, the way VA’s larger work- 
force is distributed and aligned nationwide can also significantly impact the degree 
to which it succeeds in meeting the agency’s responsibilities to veterans in the fu- 
ture. In short, VA should seize this opportunity to think more strategically about 
where to best deploy its new staff and bow to develop and maintain their skills. 

GAO Contact and Staff Acknowledgments 

Mr. Chairman, this concludes my remarks. I would be happy to answer any ques- 
tions that you or other Members of the Subcommittee may have. 

For further information, please contact Daniel Bertoni at (202) 512-7215 or 
bertonid@gao.gov. Also contributing to this statement were Clarita Mrena, Lorin 
Obler, David Forgosh, and Susan Bernstein. 
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Prepared Statement of Statement of Michael Ratajczak, Decision 
Review Officer, Cleveland Veterans Affairs Regional Office, 
Veterans Benefits Administration, U.S. Department of Veterans, 
on Behalf of American Federation of Government Employees, AFL-CIO 

Dear Chairman and Members of the Subcommittee: 

Thank you for the opportunity to testify today on behalf of the American Federa- 
tion of Government Employees, AFL-CIO (AFGE), the exclusive representative of 
employees in the Veterans Benefits Administration (VBA). 

I currently serve VBA as a Decision Review Officer (DRO) at the Cleveland VA 
Regional Office (RO). I joined VBA’s workforce in September of 2001. I worked with 
the Tiger Team Remand Unit that resolved some of the oldest pending Board of Vet- 
erans Appeals remands in the country and served as an operational model for VBA’s 
Appeals Management Center. I also served as a Specialized Rating Veterans Service 
Representative (RVSR) in the Tiger Team and the Cleveland Resource Unit of the 
Appeals Management Center. My duties with VBA have also included temporary as- 
signments to a Remand Quality Review Project which was intended, at least in part, 
to identify common errors occurring at the RO level which necessitate remand of 
cases to the RO by the Board of Veterans Appeals. I have also served as an instruc- 
tor in Centralized Challenge Courses for newly hired RVSRs. I currently serve as 
AFGE’s representative on the VBA Design Committees for Basic and Journey-level 
RVSR Certification Testing. Prior to my employment with the VA, I was an attorney 
in private practice. 

In reviewing past Congressional testimony by VBA, I was struck by the consistent 
reference to increased complexity of claims and continuing judicial refinement of the 
duty to assist veterans under the Veterans Claims Assistance Act of 2000 (VCAA) 
as factors contributing to the claims backlog. Yet, VBA’s testimony never mentioned 
the obvious impact of increasing claims complexity and duty to assist mandates on 
employees’ ability to develop and adjudicate claims, or review case development and 
adjudications upon notice of disagreement from claimants within the time con- 
straints imposed by productivity requirements set by management. 

Training and Performance Management are Closely Linked 

All who work in VBA claims processing agree that increased claims complexity 
and additional duties imposed by law are perhaps the most important factors slow- 
ing performance and reducing productivity. Therefore, in addition to adequate hir- 
ing, effective training must be an essential component of any VBA effort to increase 
the timeliness, accuracy and consistency of claims processing. Ultimately, the vet- 
erans seeking benefits are shortchanged by VBA’s failure to make any accommoda- 
tion in performance standards to reflect growing claims complexity and new legal 
requirements. VBA’s insistence on holding claims processors to production standards 
that do not allow adequate time to develop, consider, and resolve complex claims 
in accordance with the duties imposed by law is a disservice to veterans and under- 
mines the intent of the Veterans Claims Assistance Act. 

GAO found in its May 2008 report that VBA’s training program for claims proc- 
essors does not consistently track completion of training or ensure that training re- 
quirements are uniformly adhered to at the RO level. To the extent that GAO rec- 
ommends that VBA be held accountable for fully implementing and tracking the 
training it mandates, it is laudable. However, I am very concerned that the report 
could be misread to imply that individual claims processors are ultimately respon- 
sible for ensuring that they complete their mandatory training requirements. Ulti- 
mately, it is VBA management’s responsibility to provide the necessary time and re- 
sources for employees to complete well designed, comprehensive, up-to-date training 
programs. No individual claims processor can demand of local management that he 
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or she receive training when a determination is made that employee resources are 
better devoted to other concerns, such as fulfilling a monthly or fiscal year produc- 
tion goal. Management’s failure to devote time to the initial and continuing edu- 
cation of claims processors in favor of fulfilling a short-term production goal is simi- 
lar to VBA eating its seed corn, since it deprives claims processors of the means to 
become more efficient, accurate, and fulfill their ever changing and increasingly 
complex duties. 

Similarly, management’s failure to ensure adequate training time impairs the 
ability of VBA’s certification testing program for VSRs and RVSRs to be an objective 
measure of training effectiveness. This places an unfair burden on individual claims 
processors who are thus less likely to achieve a passing score on certification test- 
ing, and in turn, advance their careers. 

In order for training to be meaningful, management must afford the participant 
time to read and analyze the material, and internalize its meaning through cog- 
nitive effort and practical application. The complexity of the claims process adminis- 
tered by VBA does not admit to simple resolution by reference to checklists, decision 
trees or presentation of information without elucidation. This complexity is well il- 
lustrated by a videotape that was recently shown to VBA claims processors on the 
application of GAF (global assessment of functioning) scores in the context of assign- 
ing disability ratings for service connected posttraumatic stress disorder. This 2 
hour training video focuses on one very discrete issue in rating a very specific type 
of claim that is fraught with difficulties. It serves as a reminder that even well-pre- 
pared training material presented by highly competent and learned professionals 
can be of limited value in the absence of an opportunity for meaningful interactive 
learning. Training materials must be combined with the opportunity for trainees to 
receive timely feedback from an individual who understands the subject and can 
provide relevant, consistent, and immediate guidance to trainees struggling to inter- 
nalize the meaning of the material in the context of the duties attendant to their 
positions. 

Similarly, while materials such as Fast Letters, Training Letters, and Decision 
Assessment Documents may be useful in drawing a claims processor’s attention to 
a particular nuance or change in the claims process, they do not necessarily serve 
as useful training tools. The usefulness of such materials is further diminished if 
claims processors are not given adequate time to digest the materials VBA provides 
to notify them of changes in interpretation or implementation of policies, regula- 
tions, statutes, or case law. 

GAO’s favorable findings about the effectiveness of centralized new hire training 
confirm the benefits of a curriculum that is developed, designed and implemented 
through Central Office. Therefore, I urge this Subcommittee to support greater cen- 
tralization of mandatory continuing training, specifically a nationally uniform cur- 
riculum taught by a cadre of instructors at every RO who have completed the In- 
structor Development Curriculum, and who are available to implement training ma- 
terials designed by Central Office. The presence of a team of qualified instructors 
at every RO, charged with implementing a relevant curriculum developed by Cen- 
tral Office staff and accountable to Central Office, would help close the gap between 
VBA Central Office’s expectations for training and conflicting or incompatible goals 
of local management. 

The breakdown in VBA’s training process seems to occur at two critical junctures: 
first, at the RO where time devoted toward training may be viewed as an unwar- 
ranted impediment to achieving immediate production goals; and second, between 
Central Office and ROs because Central Office does not adequately identify trends 
in errors that are amenable to training or provide enough specific curricula for con- 
tinuing employee education. 

VBA should apply lessons learned from its Remand Quality Review Project to ac- 
quire data pertaining to common development errors by reviewing a statistically rel- 
evant sample of deferred rating decisions from a wide range of ROs. VBA should 
then use that data to tailor training to common development errors, including im- 
proper deferrals of rating decisions, and develop effective strategies to help employ- 
ees avoid those time consuming errors in the first instance. This type of feedback 
loop already exists in the healthcare arena to prevent medical errors, including the 
Veterans Health Administration that has long played a leadership role in medical 
error reduction. 

Performance Standards Must Reflect Claims Complexity and Legal Re- 
quirements 

VBA recognizes that increasingly complex claims and continuous refinement of 
the legal requirements attendant to claims processing has a detrimental effect on 
the size of VBA’s pending workload inventory. However, VBA has either failed or 
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refused to recognize that those same factors have a detrimental effect on the produc- 
tivity of individual claims processors insofar as additional time is needed to develop, 
adjudicate, or review claims. By not adjusting individual productivity standards to 
reflect the increasing complexity and difficulty of the claims process, VBA may once 
again be failing to provide the service its claimants deserve. The needs of claimants 
intersect with the requirements imposed on claims adjudicators precisely in the im- 
plementation of performance standards. If claims processors are required to choose 
between developing, rating, or reviewing a case in accordance with all legal require- 
ments and fulfilling their production requirements, a temptation is presented to 
make a decision in favor of their own immediate interests. As an example, RVSRs 
are generally given no production credit for identifying development deficiencies in 
a given case, or directing action to correct those deficiencies via deferred rating ac- 
tions. Often, such deferred actions are time-consuming and complex. Consequently, 
RVSRs are often met with a choice between meeting their productivity requirements 
and ensuring that decisions are rendered in accordance with all applicable duty to 
assist requirements and are, in essence, given no meaningful credit for ensuring 
that claims are adequately developed. One of the many unfortunate side effects of 
this problem is that the VSRs charged with developing claims oftentimes receive no 
meaningful feedback from RVSRs concerning development deficiencies. Of course, 
the ultimate effect of this system is felt by claimants, and reflected in an increasing 
appeal rate. Such a system of measuring “productivity” is disrespectful to claims 
processors and claimants alike. Productivity requirements that do not take into ac- 
count the increased time necessary to develop, adjudicate, or review increasingly 
complex claims in an increasingly stringent legal environment ultimately lead to 
bad service for claimants, since productivity is often rewarded over quality. 

As AFGE has urged this Subcommittee in the past, I cannot overstate the impor- 
tance of requiring thorough time-motion studies so that VBA performance standards 
for claims processors may be informed and adjusted by reference to valid and sci- 
entific data. Unless and until VBA has valid empirical evidence concerning what 
claims adjudicators can reasonably be expected to accomplish in a given period, any 
mandate concerning what those employees must do in the same period will be sus- 
pect. Moreover, insofar as such suspect standards are used to project the need for 
additional human resources or trends concerning future claims inventory levels, any 
projections upon which they are based will also be suspect. The proposal in H.R. 
5892 for a study of the VBA work credit system will provide valuable data toward 
this goal. 

Nor should VBA continue to set performance standards for claims processors by 
fiat with reference to the “experience” of managers who are years removed from any 
meaningful contact with the day-to-day exigencies of claims processing, and expect 
to meaningfully address workload trends or human capital requirements. These 
managers should be required to devote a portion of their workday (e.g. 50 percent) 
to developing or adjudicating claims in order to keep a fresh perspective of what it 
takes to conform to an individual position description. Such a requirement would 
also have the benefit of reducing the pending claims inventory. Therefore, I also 
support the requirement in H.R. 5892 that managers pass the same certification 
tests as the employees they supervise. The absence of such a requirement would 
permit non-certified supervisors to be charged with critiquing the work of certified 
employees, thereby seriously undermining the credibility of the certification process. 

Increased tracking and implementation of continuing training at VBA is laudable, 
but only insofar as it will ultimately serve claimants. An educated and well-trained 
workforce should be one of VBA’s highest goals. However, VBA’s claims processing 
workforce must also be afforded adequate time to perform their duties in accordance 
with their training, and that consideration must be reflected in individual perform- 
ance standards. 

Methods to Increase Accountability and Reduce Rating Variances 

If continuing training of VBA claims processors is made consistent by reference 
to a curriculum created by VBA centralized training staff and implemented by a 
corps of instructors accountable to VBA’s Central Office, rating variances could rea- 
sonably be expected to decrease as claims processors conform their individual activi- 
ties to their uniform training. 

Conclusion 

I view the GAO report not as an indictment on claims processors’ skills, abilities, 
or willingness to learn as much as a description of VBA’s failure to provide relevant, 
useful continuing training or adequately track the efficacy of that training. Ulti- 
mately, training deficiencies at VBA are not the product of nor should they be the 
responsibility of individual claims processors. 
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The claims processing workforce at VBA is among of the finest and most dedi- 
cated workforces in Government. Unfortunately, insofar as VBA inadequately pro- 
vides continuing training to claims processors and then attempts to hold them re- 
sponsible for deficiencies in quality and productivity, claims processors may be dis- 
proportionately affected by inadequate training. To illustrate that fact it might be 
instructive for this Subcommittee to inquire of VBA whether they can recall a single 
instance of any VBA manager who has ever been disciplined, demoted, or formally 
reprimanded for failing to adequately train an employee. In contrast, there are nu- 
merous instances of long term claims processors with good work histories being dis- 
ciplined, demoted, formally reprimanded, or even discharged for failing to meet their 
productivity or quality requirements. Tbe crux of the problem is a failure by VBA 
to provide the continuing training necessary for our Members to be productive, effi- 
cient and accurate in fulfillment of their duties. The onus of inadequate training 
should not be disproportionately borne by employees charged with the day to day 
processing of claims or the constituency they are honored to serve. Thank you. 


Prepared Statement of Kerry Baker, Assistant National Legislative 
Director, Disabled American Veterans 

Mr. Chairman and Members of the Subcommittee: 

On behalf of the 1.3 million members of the Disabled American Veterans (DAV), 
I am honored to appear before you today to discuss the effectiveness of the Veterans 
Benefits Administration’s (VBA’s) training, performance management, and account- 
ability requirements. In accordance with our congressional charter, the DAV’s mis- 
sion is to “advance the interests, and work for the betterment, of all wounded, in- 
jured, and disabled American veterans.” 

TRAINING 

VBA has a standard training curriculum for new claims processors and an 80- 
hour annual training requirement for all claims processors. The training program 
in VBA is basically a three-stage system. First, VBA policy requires new staff to 
complete some orientation training, which is provided in their home offices. Second, 
they are required to attend a 2- to 3-week centralized training course that provides 
a basic introduction to job responsibilities. Third, new staff are required to spend 
several more months in training at their home offices, which includes on-the-job 
training and/or instructor-led training that follow a required curriculum via use of 
an online learning tool called the Training and Performance Support System 
(TPSS). VBA policy states that all claims processors are required to complete a min- 
imum of 80 hours of training annually. VA Regional Offices (ROs) have some discre- 
tion over what training they provide to meet this requirement. 

The VA’s three-phased program for new claims processors is designed to deliver 
standardized training, regardless of training location or individual instructors. Top- 
ics included in the training program contain a lesson plan with review exercises, 
student handouts, and copies of slides used during the instructor’s presentation. The 
VBA also has an annual 80-hour training requirement for new and experienced rat- 
ing veterans’ service representatives (RVSRs) and veteran service representatives 
(VSRs). 

The first phase of training for new RVSRs is prerequisite training. It begins at 
new RVRSs’ home regional offices when they begin working. The prerequisite train- 
ing is designed to lay the foundation for future training by introducing new employ- 
ees to topics such as the software applications used to process and track claims, 
medical terminology, the system for maintaining and filing a case folder, and the 
process for requesting medical records. VBA specifies the topics that must be cov- 
ered during prerequisite training: however, ROs can choose the format for the train- 
ing and the timeframe. New VSRs and RVSRs typically spend two to 3 weeks com- 
pleting prerequisite training in their home office before they begin the second pro- 
gram phase. Nonetheless, VA personnel informed the DAV that many new employ- 
ees are only allowed approximately 7 days to complete the training. 

The second phase of training is known as centralized training, wherein new VSRs 
and RVSRs spend approximately 3 weeks in classroom training. The 3-week time- 
frame is misleading because the first and last portions of week one and three are 
utilized for travel. Therefore, the actual training time is closer to 2 weeks. 

Participants from multiple ROs are typically brought together in centralized 
training sessions, which is usually at the Veterans Benefits Academy in Baltimore, 
Maryland. Centralized training provides an overview of the technical aspects of the 
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VSR and RVSR positions. These training classes usually have at least three instruc- 
tors, but the actual number can vary depending on the size of the group. VBA’s goal 
is to maintain a minimum ratio of instructors to students. 

To practice processing different types of claims, VSRs work on either real or hypo- 
thetical claims specifically designed for training. Centralized training for new 
RVSRs focuses on topics such as: systems of the human body; how to review medical 
records; and, how to interpret medical exams. To provide instructors for centralized 
training, VBA relies on RO staff who have received training on how to be an in- 
structor. Centralized training instructors may be VSRs, RVSRs, supervisors, or 
other staff identified by RO managers as having the capability to be effective in- 
structors. 

The VBA has increased the number of training sessions because of the influx of 
new staff. In fiscal year 2007, VBA increased the frequency of centralized training 
and its student capacity at the Veterans Benefits Academy. During fiscal year 2007, 
VBA held 67 centralized training sessions for 1,458 new VSRs and RVSRs. Central- 
ized training sessions were conducted at 26 different ROs during fiscal year 2007, 
in addition to the Veterans Benefits Academy. By comparison, during fiscal year 
2006, VBA held 27 centralized training sessions for 678 new claims processors. 
Nonetheless, VBA has not run its benefits academy near to full capacity in 2008, 
the reasons for which are unclear. 

When new VSRs and RVSRs return to their home office after centralized training, 
they are required to begin their third phase of training, which is supposed to include 
on-the-job, classroom, and computer-based training modules that are part of VBA’s 
Training and Performance Support Systems (TPSS), all conducted by and at the RO. 
New VSRs and RVSRs typically take about 6 to 12 months after they return from 
centralized training to complete all the training requirements for new staff. 

In addition to the foregoing three-phase training program, VBA also requires 80 
hours of annual training for all VSRs and RVSRs. The training is divided into two 
parts. At least 60 hours must come from a list of core technical training topics iden- 
tified by Compensation and Pension (C&P) Service. VBA specifies more core topics 
than are necessary to meet the 60-hour requirement, so regional offices can choose 
those topics most relevant to their needs. They can also choose the training method 
used to address each topic, such as classroom or TPSS training. The RO managers 
decide the specificities of tbe remaining 20 hours. 

Analysis and Recommendations 

The DAV has consistently maintained that VA should invest more in training ad- 
judicators and decision-makers, and that it should hold them accountable for higher 
standards of accuracy. Nonetheless, such training has not been a high priority in 
VBA. We have further consistently stated that proper training leads to better qual- 
ity, and that quality is the key to timeliness. Timeliness follows from quality be- 
cause omissions in record development, failure to afford due process, and erroneous 
decisions require duplicative work, wbich add to the load of an already overbur- 
dened system. The VBA will only achieve such quality when it devotes adequate re- 
sources to perform comprehensive and ongoing training, devotes sufficient time to 
each case, and imposes and enforces quality standards through effective quality as- 
surance methods and accountability mechanisms. 

One of the most essential resources is experienced and knowledgeable personnel 
devoted to training. More management devotion to training and quality requires a 
break from the status quo of production goals above all else. In a 2005 report from 
VA’s Office of Inspector General, VBA employees were quoted as stating: “Although 
management wants to meet quality goals, they are much more concerned with quan- 
tity. An RVSR is much more likely to be disciplined for failure to meet production 
standards than for failing to meet quality standards,” and that “there is a lot of 
pressure to make your production standard. In fact, your performance standard cen- 
ters around production and a lot of awards are based on it. Those who don’t produce 
could miss out on individual bonuses, etc.” 1 Little if anything has changed since the 
Inspector General has issued this report. 

A review of VBA’s training programs mentioned above reveals that its problems 
caused by a lack of accountability do not begin in the claims development and rating 
process — they begin in the training program. Essentially, we can find little, if any, 
measurable accountability in VBA’s training program. 

For example, despite VBA’s program requirements for its new hires to complete 
phase-one training before advancing to the phase-two centralized training, some VA 
employees anonymously informed the DAV that many candidates begin centralized 


1 Department of Veterans Affairs Office of Inspector General, Rep. No. 05-00765-137, Review 
of State Variances in VA Disability Compensation Payments 61 (May 19, 2005). 
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training without having had the opportunity to participate in and/or complete 
phase-one training. Additionally, candidates are not held responsible via formal test- 
ing on subjects taught during phase-one training. While oversight may or may not 
exist for this portion of training, the DAV could find none. 

Without resorting to a critique of the substance of VBA’s subject matter taught 
during phase-two training, or any other phase for that matter, we limit our analysis 
again to accountability. As in phase one, VBA refuses to test participants of phase- 
two training. The obvious goal is to ensure employees attend the required course — 
ensuring that employees achieve VBA’s learning objectives appears to have no pri- 
ority whatsoever. 

By now, a new employee has approximately 1 month of training and is supposedly 
prepared for phase-three training. Keep in mind that during phase three, new em- 
ployees will work on real-world cases whose outcomes affect the lives and livelihoods 
of disabled veterans and their families. Real cases notwithstanding, again there is 
no accountability, no testing, and no oversight outside that of which is provided lo- 
cally; again, that oversight is not measured nationally. 

The result of such an unsupervised and unaccountable training system is that no 
distinction exists between unsatisfactory performance and outstanding performance. 
This lack of accountability during training further reduces, or even eliminates, em- 
ployee motivation to excel. This institutional mindset is further epitomized in VBA’s 
day-to-day performance, where employees throughout VBA are reminded daily that 
optimum work output is far more important quality performance and accurate work. 

The effect of VBA’s lack of accountability in its training program was dem- 
onstrated when it began offering skills certification tests to support certain pro- 
motions. Beginning in late 2002, VSR job announcements began identifying VSRs 
at the GS-11 level, contingent upon successful completion of a certification test. The 
test consisted of 100 multiple-choice questions, which were open-book. The VA al- 
lowed participants to use online references and any other reference material, includ- 
ing individually prepared notes in order to pass the test. 

The first validation test was performed in August 2003. There were 298 partici- 
pants in the first test. Of these, 75 passed for a pass rate of 25 percent. VBA con- 
ducted a second test in April 2004. Out of 650 participants, 188 passed for a pass 
rate of 29 percent. Because of the low pass rates on the first two tests, a 20-hour 
VSR “readiness” training curriculum was developed to prepare VSRs for the test. 
A third test was administered on May 3, 2006, to 934 VSRs nationwide. Still, the 
pass rate was only 42 percent. Keep in mind that these tests were not for training, 
they were to determine promotions from GS-10 to GS-11. 

The VBA recently began similar testing with RVSRs. The DAV was unable to ob- 
tain those tests result. VA employees nonetheless informed us that VBA’s test re- 
sults for RVSRs were no better than test results for VSRs. 

These results reveal a certain irony, in that VBA will offer a skills certification 
test for promotion purposes, but does not require comprehensive testing throughout 
its training curriculum. The following “accountability” portion of this testimony fur- 
ther illustrates the product of inadequate training. 

Mandatory and comprehensive testing designed cumulatively from one subject 
area to the next, for which VBA then holds trainees accountable, should be the 
number one priority of any plan to improve VBA’s training program. Further, VBA 
should not allow trainees to advance to subsequent stages of training until they 
have successfully completed such testing. 

To be fair, the DAV understands that VBA is not solely at fault on this subject. 
The VA employees union has objected to the type of testing mentioned herein. We 
do not expect such objections to cease. In fact, we feel the only way to moot these 
objections is for Congress to mandate such testing through statutory change. Section 
105 of H.R. 5892 mandates some testing for claims processors and VBA managers, 
which is an improvement over current practices; however, it does not mandate the 
type of testing during the training process as explain herein. Measurable improve- 
ment in the quality of and accountability for training will not occur until such man- 
dates exist. 


ACCOUNTABILITY 

The DAV has consistently stated that, in addition to training, accountability is the 
key to quality, and therefore to timeliness as well. As it currently stands, almost 
everything in VBA is production driven. In addition to basing personnel awards on 
production, the DAV strongly believes that quality should be awarded at least on 
parity with production. However, in order for this to occur, VBA must implement 
stronger accountability measures for quality assurance. 
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VA’s quality assurance tool for compensation and pension claims is the Systematic 
Technical Accuracy Review (STAR) program. Under the STAR program, VA reviews 
a sampling of decisions from regional offices and bases its national accuracy meas- 
ures on the percentage with errors that effect entitlement, benefit amount, and ef- 
fective date. 

Inconsistency signals outright arbitrariness in decision-making, uneven or insuffi- 
cient understanding of governing criteria, or rules for decisions that are too vague 
or overly broad and allows them to be applied according to the prevailing mindset 
of a particular group of decision-makers. Obviously, VA must detect inconsistencies 
before the cause or causes can be determined and remedied. 

Simply put, there is a gap in quality assurance for purposes of individual account- 
ability in quality decision-making. In the STAR program, a sample is drawn each 
month from a regional office workload divided between rating, authorization, and 
fiduciary end-products. For example, a monthly sample of “rating”-related cases gen- 
erally requires a STAR review of 10 rating-related end products. 2 Reviewing 10 rat- 
ing-related cases per month for an average size regional office, an office that would 
easily employee more than three times that number of raters, is undeniable evi- 
dence of a total void in individual accountability. If an average size regional office 
produced only 1,000 decisions per month, which we feel is quite conservative, the 
STAR program would only review 1 percent of the total cases decided by that re- 
gional office. Those figures leave no room for trend analysis, much less personal ac- 
countability. 

To put this in better perspective, according to VA’s 2007 performance and ac- 
countability report, the STAR program reviewed 11,056 compensation and pension 
(C&P) cases in 2006 for improper payments. While this number appears significant, 
the total number of C&P cases available for review was 1,540,211. Therefore, the 
percentage of cases reviewed was approximately seven tenths of 1 percent, or 0.72 
percent. 

Another method of measuring the VA’s need for more accountability is an analysis 
of the Board’s Summary of Remands, while keeping in mind that its summary rep- 
resents a statistically large and reliable sample of certain measurable trends. The 
examples must be viewed in the context of the VA (1) deciding 700,000 to 800,000 
cases per year; (2) receives over 100,000 NODs; and (3) submits 40,000 appeals to 
the Board. The examples below are from October 2006 to October 2007. 

Remands resulted in 998 cases because no “notice” under section 5103 was ever 
provided to the claimant. The remand rate was much higher for inadequate or incor- 
rect notice; however, considering the confusing (and evolving) nature of the law con- 
cerning “notice,” we can only fault the VA when it fails to provide any notice. 

VA failed to make initial requests for SMRs in 667 cases and failed to make ini- 
tial requests for personnel records in 578 cases. The number was higher for addi- 
tional followup records requests following the first request. This number is dis- 
turbing because initially requesting a veteran’s service records are the foundation 
to every compensation claim. It is claims development 101. 

The Board remanded 2,594 cases for initial requests for VA medical records and 
3,393 cases for additional requests for VA medical records. The disturbing factor 
here is that a VA employee can usually obtain VA medical records without ever 
leaving the confines of one’s computer screen. 

Another 2,461 cases were remanded because the claimant had requested a travel 
board hearing or video-conference hearing. Again, there is a disturbing factor here. 
A checklist is utilized prior to sending an appeal to the Board that contains a sec- 
tion that specifically asked whether the claimant has asked for such a hearing. 

The examples above totaled 7,298 cases or nearly 20 percent of appeals reaching 
the Board, all of which cleared the local rating board and the local appeals board 
with errors that are elementary in nature. Yet they were either not detected or they 
were ignored. Many more cases were returned for more complex errors. But for 
nearly a 20-percent error rate on such basic elements in the claims process passing 
through VBA’s most senior of rating specialist is simply unacceptable. 

The problem with the VA’s current system of accountability is that it does not 
matter if VBA employees ignored these errors because those that commit such er- 
rors are usually not held responsible. They therefore have no incentive to concern 
themselves with the quality of their work. Above all else, these figures showing that 
the VA’s quality assurance and accountability systems require significant enhance- 
ment. 


2 See M21-4, Ch. 3, §3.02. 
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Recommendation 

Congress should require the Secretary to report on how the Department could es- 
tablish a quality assurance and accountability program that will detect, track, and 
hold responsible those VA employees who commit egregious errors. Such report 
should be generated in consultation with veterans’ service organizations most expe- 
rienced in the VBA claims process. 

The DAV believes that effective accountability can be engineered in a manner 
that holds each VBA employee responsible for his/her work as a claim moves 
through the system while at the same time holds all employees responsible simulta- 
neously. As errors are discovered (definition of such errors to be determined, but 
specific to employee responsibility), employees responsible for such errors must be 
held accountable by forfeiture of work credit percentage. 

For example, if a Decision Review Officer (DRO) reverses a decision from a front- 
line rating specialist because of error, as opposed to difference of opinion or receipt 
of new evidence, then the frontline employee should be subject to forfeiture of a por- 
tion of work credit that is normally used to track production standards applicable 
to performance bonuses. In turn, if a case proceeds to the BVA and is reversed or 
remanded on similar grounds, then both the frontline rater as well as the DRO 
should forfeit work credit, and so one. The same should apply to Veterans’ Law 
Judges at BVA when the Court of Appeals for Veterans Claims finds error in a BVA 
decision. 

Such a cumulative accountability system would effectively eliminate potential 
abuse of the system through the proverbial good-old-boy club. One employee would 
be far less likely to cover for errors or look the other way from errors committed 
by a fellow employee if they knew their performance standards were equally at risk. 
This type of system would ensure personal accountability at every stage in the 
claims process without seriously disrupting or dismantling VBA’s current perform- 
ance measurement system. 

PERFORMANCE MEASUREMENT 

VA’s benefits delivery system has become particularly multifaceted, especially 
when considering the various types of claims a beneficiary may file, the various 
stages of development and decision-making within each claim, and the potential 
changes that can occur at any particular stage of the claim. Currently, VA utilizes 
over 50 pending end-product codes 3 for a multitude of actions. The number of end- 
product codes may be further expanded by using “modifiers” that designate specific 
“issues” for types of claims within a certain broader category. 

The VA’s end product codes are used in conjunction with its productivity and work 
measurement system. The productivity system is the basic system of work measure- 
ment used by C&P Service, but it is also used for report and tracking. Additionally, 
VA’s end-product codes are also utilized in the STAR program. The program is also 
a tool used for quantitative measurement, a tool utilized in preparing budget fore- 
casts, and in distributing available staffing. 

Quantitative and productivity measurement are also tools used in comparing and 
tracking employment of resources. Both productivity measurement and work meas- 
urement are tools available to management for this purpose. Quantitative measure- 
ment also allows Central Office and Area Offices to compare stations and to track 
both local and national trends. Productivity measurement and work measurement 
are complementary measurement systems that each depend, in part, on VA’s end 
product code system. The end-product code system is further used in determining 
work credit provided to VA’s employees and is therefore vital in measuring employee 
production goals and awarding performance awards. Changes should not be man- 
dated that would cause VA to lose the ability to manage and track its day-to-day 
functions. 

The DAV finds no measurable flaws in VBA’s overall measurement systems. In 
fact, our foregoing recommendations concerning improvements in VBA’s account- 
ability would draw on the strengths in its measurement systems, thereby allowing 
easier and less disruptive implementation of stronger and more effective account- 
ability. 


3 M2 1-4, App. A, Glossary of Terms and Definitions. Manpower Control and Utilization in Ad- 
judication Divisions (Pending End Product: “A claim or issue on which final action has not been 
completed. The classification code identified refers to the end product work unit to be recorded 
when final disposition action has been taken.”). 
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We hope the Subcommittee will review these recommendations and give them con- 
sideration for inclusion in your legislative plans. Mr. Chairman, thank you for invit- 
ing the DAY to testify before you today. 


Prepared Statement of Ronald B. Abrams, Joint Executive Director, 
National Veterans Legal Services Program 

Mr. Chairman and Members of the Committee: 

I am pleased to have the opportunity to submit this testimony on behalf on behalf 
of the National Veterans Legal Services Program (NVLSP). NVLSP is a nonprofit 
veterans service organization founded in 1980 that has been assisting veterans and 
their advocates for 28 years. NVLSP has trained thousands of service officers and 
lawyers in veterans benefits law, and has written educational publications that 
thousands of veterans advocates regularly use as practice tools to assist them in 
their representation of VA claimants. NVLSP also conducts quality reviews of the 
VA regional offices on behalf of The American Legion. NVLSP also represents vet- 
erans and their families on claims for veterans benefits before VA, the U.S. Court 
of Appeals for Veterans Claims (CAVC), and other Federal courts. Since its found- 
ing, NVLSP has represented over 1,000 claimants before the Board of Veterans’ Ap- 
peals and the Court of Appeals for Veterans Claims (CAVC). NVLSP is one of the 
four veterans service organizations that comprise the Veterans Consortium Pro 
Bono Program, which recruits and trains volunteer lawyers to represent veterans 
who have appealed a Board of Veterans’ Appeals decision to the CAVC without a 
representative. 

We believe that the effectiveness of VBA training should be measured by the qual- 
ity of the work product produced by VA adjudicators. Therefore, the quality and 
timeliness of VA adjudications should reflect the effectiveness or lack thereof, of VA 
training. Because the quality of VA adjudications is inadequate NVLSP must con- 
clude that VBA training is not effective or adequate. 

In the experience of NVLSP (over 10 years of quality reviews, in conjunction with 
The American Legion of approximately 40 different VAROs combined with extensive 
NVLSP representation before the CAVC), most of the most egregious VA errors are 
a result of premature adjudications. Many VA managers emphasize quantity over 
quality. VA managers and VA adjudicators have let us know that because produc- 
tion is paramount, training is deemphasized because the time spent training re- 
duces the time available to produce decisions, and the training of VA adjudicators 
regarding the procedures designed to protect the right of claimants seeking VA ben- 
efits also reduces production. 

In September 2008, courageous VA regional office employees filed a grievance ex- 
posing this overemphasis on production. This grievance is attached to my testimony. 
The grievance asserts that: 

• the regional office created and encouraged a culture in which quantity is em- 
phasized to the detriment of quality, 

• fhe VARO failed to properly implement training initiatives to assure that those 
reviewing claims are sufficiently trained in the relevant disciplines so as to re- 
duce errors, improve the quality of claims processing, and successfully complete 
newly implemented certification requirements; and 

• the VARO failed to properly implement a fair and impartial performance ap- 
praisal system that assures that quantitative measures of performance are not 
emphasized to the detriment of measures of the quality of that performance. 

NVLSP believes that the quality of VARO adjudications is much worse than what 
is reported by the VA. The remand and reversal statistics produced by decisions 
issued by the Board of Veterans’ Appeals (BVA or Board) can be considered an inde- 
pendent review of the quality of adjudications performed by the VAROs. BVA statis- 
tics provided by the Veterans Appeals Control and Locator System (VACOLS) for FY 
07 reveal that Board decided over 40,000 appeals. The Board allowed 21.12 percent 
(that is, granted the claim that the VA regional office had denied) and remanded 
35.36 percent of these appeals back to the VARO because the VARO had wrongly 
failed to obtain all of the evidence it should have attempted to obtain. Therefore, 
in 56.48 percent of the appeals decided by the BVA, the BVA either reversed or re- 
manded the VARO decision. This 56.48 percent statistic could be considered an 
error rate. Even if we take into account the fact that new evidence can be added 
at the Board and deduct 20 percent from the 56.48 percent, an error rate as high 
as 36 percent is not acceptable and does not verify the low error rate claimed by 
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VA in its VA Star Reports (close to a 90 percent “accuracy rate”). The reversal/re- 
mand rate thus far for FY 2008 is 59.4 percent. 

The news gets worse. The BVA, in its rush to make final decisions and to avoid 
remands also quite often prematurely denies claims that should have been re- 
manded. Of course, the error was originally committed by the VARO, not the BVA. 
In September 2007, my fellow Joint Executive Director, Bart Stichman, testified 
that “[f]or more than a decade, the Court’s [Court of Appeals for Veterans Claims 
(Court or CAVC)] annual report card of the BVA’s performance has been remarkably 
consistent. The 12 annual report cards issued over the last 12 years yields the fol- 
lowing startling fact: of the 16,550 Board decisions that the Court individually as- 
sessed over that period (that is, from FY 1995 to FY 2006), the Court set aside a 
whopping 77.7 percent of them (that is, 12,866 individual Board decisions). In each 
of these 12,866 cases, the Court set aside the Board decision and either remanded 
the claim to the Board for further proceedings or ordered the Board to award the 
benefits it had previously denied. In the overwhelming majority of these 12,866 
cases, the Court took this action because it concluded that the Board decision con- 
tained one or more specific legal errors that prejudiced the rights of the VA claimant 
to a proper decision.” 

How should a veteran seeking VA disability benefits feel? The Board of Veterans’ 
Appeals reverses and remands over 50 percent of all VARO adjudications and the 
CAVC sets aside over 77 percent of the BVA decisions that it reviews. These num- 
bers do not inspire confidence in the quality of VA adjudications. 

It is clear that the adjudication culture at the VAROs needs to be changed. Many 
VA managers act like they are producing widgets rather than adjudicating claims 
filed by real people. Their goal should not be just prompt adjudication; the goal 
should be a timely, accurate and fair adjudication. 

Even VA employees are frustrated and upset by their lack of training and the 
overemphasis on production. The following is a quote from the grievance attached 
to my testimony. 

“As set forth in the Grievance, management has: (1) established an environ- 
ment in which “there is an extreme pressure to produce minimally acceptable 
work at any cost”; (2) “developed an employee culture where striving to 
achieve unreasonable production criteria is paramount and . . . actually 
doing difficult necessary work on cases is strongly discouraged on penalty 
of removal”; and (3) [management] commonly expresses sentiments such as, 

“just decide the case and let the veteran appeal.” 

If the assertions in this grievance are true then we call upon VA Central Office 
management to hold regional office management accountable. 

Thank you for permitting NVLSP to testify on such an important issue. 


Kirkland and Ellis LLP 
Chicago, IL 
August 29, 2008 

Via OVERNIGHT MAIL 
Joyce A. Cange 

Director, Cleveland Regional Office 
Department of Veterans Affairs, 

Veterans Benefits Administration 
A.J. Celebrezze Federal Building 
1240 East 9th Street 
Cleveland, Ohio 44199 

Re: April 2008 Grievance Of Local 2823 

Dear Ms. Cange: 

I write to advise that Kirkland & Ellis LLP represents Local 2823 of the Amer- 
ican Federation of Government Employees (“Local 2823”) in connection with the 
grievance that Local 2823 filed and amended in April 2008 (the “Grievance” or 
“GRV”), and I further write to respond to an April 25, 2008 memorandum (the 
“Memorandum” or “MEM”) from your office that denied the Grievance for various 
reasons. 1 


1 Local 2823 does not address herein all the matters raised by its Grievance or assertions 
made by your office’s Memorandum in response, as Local 2823 does not believe that such 
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1. The Grievance 

Local 2823’s Grievance demands resolution of several disputes that Local 2823 be- 
lieves are negatively affecting the processing of veterans’ benefits claims at the 
Cleveland VA Regional Office (the “Cleveland VARO”). Specifically, the Grievance 
states that management of the Cleveland VARO has, among other things: 

1. created and encouraged a culture in which the quantity of benefits claims 
rated is emphasized to the detriment of the quality of the rating of those 
claims ( see GRV at 3-4 ^ (6)(b)-(d); hereafter, the “Culture Claim”); 2 

2. failed to properly, equitably and promptly implement training initiatives to as- 
sure that those reviewing claims are sufficiently trained in the relevant dis- 
ciplines so as to reduce errors, improve the quality of claims processing, and 
successfully complete newly implemented certification requirements ( see GRV 
at 2-3 n 5(d)-(e); hereafter the “Training Claim”); 3 and 

3. failed to properly implement a fair and impartial performance appraisal system 
that assures that quantitative measures of performance are not emphasized to 
the detriment of measures of the quality of that performance ( see GRV at 4 
*11 6(a); hereafter the “Performance Appraisal Claim”). 4 

While recent disputes between management and Local 2823 (and certain of its of- 
ficers) unfortunately have created an adversarial atmosphere and tone, it is impor- 
tant to underscore and reaffirm that Local 2823’s fundamental reason for instituting 
this Grievance is to improve the quality of the processing of benefits claims by as- 
suring that those responsible for reviewing such claims are (i) encouraged and ex- 
pected to perform high quality reviews (even where doing so may reduce the quan- 
tity of claims that can be reviewed), (ii) sufficiently trained to perform these high 
quality reviews, and (iii) appraised based both on the quality as well as the quantity 
of their ratings — all of which, Local 2823 believes, is consistent with and required 
by VA policy, applicable agreements of the parties, and applicable law. 

Local 2823 believes that the best way to achieve these objectives is by working 
collaboratively and cooperatively with management to achieve them. 5 Accordingly, 


unaddressed matters need to be resolved at this juncture to have a productive discussion of the 
principal disputes between the parties. However, Local 2823 does not waive and expressly re- 
serves all rights and claims it has, including those that are not expressly addressed herein but 
are otherwise fairly encompassed by the Grievance. 

2 This may be one of the reasons why Ohio ranks second to last nationally in the average com- 
pensation awarded to its disabled veterans according to the VBA’s Annual Benefits Report for 
FY2006. See, e.g., The Plain Dealer at A7 (Apr. 12, 2008) (summarizing disparate disability com- 
pensation averages across states, with only Indiana having a lower average than Ohio, but hav- 
ing fewer than half of the number of disability recipients as Ohio); accord VBA Annual Benefits 
Report — Fiscal Year 2006 at 103 1A0953 (state-by-state figures). 

3 See, e.g., 1997 Master Agreement between the Dep’t of Veterans Affairs and the Am. Fed’n 
of Gov’t Employees [hereafter, “MA”] at 142 (Art. 34) § 1(A) (“The Department and the Union 
agree that the training and development of employees is of critical importance in carrying out 
the mission of the Department.”); id. §9 (“Procedures which ensure fair and equitable training 
opportunities are appropriate subjects for local bargaining.”). See also 1/20/00 VBA-AFGE Mem. 
of Understanding [hereafter “1/20/00 MOU”] 2 (‘VBA commits to a standard of excellence in 
the quality and quantity of training for all employees.”); id. 1 10 (“Local unions will be given 
the opportunity to bargain over appropriate issues not otherwise in conflict with this or other 
national level agreements, prior to local implementation.”); 5/19/06 Mem. of Understanding; In- 
terim Cert. MOU for FY2006 [hereafter “5/19/06 MOU”] at preamble (“The terms of the original 
MOU on Certification dated 2000 are still in effect.”); id. *11 15 (“The parties may negotiate locally 
on this subject provided it does not conflict, interfere with, or impair the implementation of this 
MOU and the Master Agreement.”). 

4 See, e.g., Am. Art. 26 § 1(D) (“The parties share an interest in improving the performance 
of the Department’s workforce”); id. § 1(H) (“The performance appraisal process as set forth in 
this Article is intended to be innovative and evolutionary in nature. Its effectiveness is critical 
to the Department achieving its mission.”). 

5 See, e.g., MA at 4 (Preamble) §2 (“The Department and the Union agree that a constructive 
and cooperative working relationship between labor and management is essential to achieving 
the Department’s mission and to ensuring a quality work environment for all employees. The 
parties recognize that this relationship must be built on a solid foundation of trust, mutual re- 
spect, and a shared responsibility for organizational success. [^] Therefore, the parties agree to 
work together in partnership and through this Master Agreement to identify problems and craft 
solutions, enhance productivity, and deliver the best quality of service to the Nation’s vet- 
erans.”) (emphasis added). See also id. at 8 (Art. 3) §2 (noting important “Partnership” prin- 
ciples that are to characterize parties’ relationships, including “Shared responsibility,” “Sharing 
of information,” “Reaching joint agreements and making joint recommendations,” “Use of alter- 
native dispute resolution, interest-based, problem-solving techniques, and facilitation,” and “In- 
tegration of interests” — all addressed to the common goal of establishing and improving “effec- 
tive Partnerships which are designed to ensure a quality work environment for employees, more 

Continued 
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Local 2823 and the undersigned request that within the next 2 weeks you provide 
them with a date and time when we can sit down with you and your management 
team in the next 60 days to see if there is a way that the parties can work together 
to accomplish the aforementioned objectives and resolve their differences by means 
of such ADR. 6 

If, however, management is unwilling to work collaboratively to achieve these ob- 
jectives, then Local 2823 has a responsibility to its members (and to veterans) to 
prosecute the Grievance vigorously by commencing arbitration proceedings, which 
Local 2823 will not hesitate to do. Moreover, should the matter proceed to arbitra- 
tion, for the reasons set forth below, we are confident that the arbitrator will find 
in Local 2823’s favor and that your legal and other objections to the Grievance that 
are recited in the Memorandum will not be sustained. 

2. The Culture Claim 

As set forth in the Grievance, management has: (1) established an environment 
in which “there is an extreme pressure to produce minimally acceptable work at any 
cost”; (2) “developed an employee culture where striving to achieve unreasonable 
production criteria is paramount and . . . actually doing difficult necessary work on 
cases is strongly discouraged on penalty of removal”; and (3) commonly expresses 
sentiments such as, “just decide the case and let the veteran appeal.” (See GRV at 
4 16(a); id. 116(a), (b) & (d).) 

A. The Culture Claim I Sufficiently Particular 

The Memorandum your office issued takes exception to the Grievance, inter alia, 
on the grounds that it is insufficiently particular in that it does not identify: (1) “any 
specific acts that are being grieved”; (2) “any specific times, dates and places for any 
acts being grieved”; and (3) “any rationale supporting or even explaining how VBA’s 
alleged conduct violated any negotiated agreements or law.” (Mem. at 1 13.) The 
Memorandum, however, notably fails to identify any agreement or law requiring 
that Local 2823’s step-three grievance (see GRV at 1 1 1) be stated with greater par- 
ticularity — because there is none. 

While the Master Agreement recites that a step-two grievance “must state, in de- 
tail, the basis for the grievance and the corrective action desired” (MA at 166 (Art. 
42) § 7 (emphasis added)), no such requirement is prescribed for a step-three griev- 
ance like the one at issue here. Regardless, even were the Grievance deemed a step- 
two grievance (or deemed bound by a similar “detailed basis” requirement), the 
Grievance does “state, in detail, the basis for the grievance” — e.g., the Culture 
Claim, the Training Claim, and the Performance Appraisal Claim. Moreover, the 
Master Agreement does not state that “all facts ” supporting a grievance must be 
recited in the grievance in order to satisfy the “detailed basis” requirement of Arti- 
cle 42 §7; it does not require that all “acts” encompassed by the grievance be sepa- 
rately listed; it does not require specification of times, dates, and places for all acts 
encompassed by a grievance; and it does not require an explanation of each of the 
ways in which the conduct at issue violated each applicable agreement and/or law. 
Nor would it be reasonable to impose such a particularized pleading requirement 
on Local 2823 — before any documents have been turned over by management relat- 
ing to the claims pled as the basis for the Grievance. 


efficient administration of VA programs, and improved service to veterans ”) (emphasis 
added); id. §3 (“The scope of partnership will include issues raised by either party regarding: 
A. Matters involving personnel policies, practices, and working conditions.”); id. at 15 (Art. 7) 
§ 1 (“Service to the veteran is the cornerstone of the relationship between the Department and 
employees.”); id. at 177 (Art. 146) § 1 (“The parties recognize that a new relationship between 
the Union and the Department as full partners is essential for reforming the Department into 
an organization that works more efficiently and effectively and better serves customer needs, 
employees, Union representatives and managers.”). 

6 See, e.g., Master Agreement at 13 (Art. 6) §1 (“Union and Management at all levels should 
be committed to use of ADR problem-solving methods as a priority to resolve disputed mat- 
ters.”); id. §4(A) (“ADR is an appropriate subject matter for local negotiations.”); id. at 14 (Art. 
6) §4(D) (“ADR methods may be used prior to or during a grievance/arbitration or statutory ap- 
peal.”); id. at 165 (Art. 42) §6 (“The use of ADR is encouraged. The parties agree that every 
effort will be made to settle grievances at the lowest possible level.”); VA Dir. 5023 § 2(a) (“It 
is the policy of VA to recognize and deal with lawful labor organizations on matters of concern 
to the employees they represent, and to place primary reliance on informal settlement of any 
differences or disputes at the earliest stage possible by discussion between VA management and 
representatives of labor organizations.”). 
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B. The Culture Claim Is Based on Violations of Applicable VA Policies, 

Agreements, and/or Law 

Actions of management giving rise to the Culture Claim violate VA policy as well 
as applicable agreements and law. 

First, VA Directive 5023 properly states and acknowledges that “[tlhe public in- 
terest demands the highest standards of employee performance and the continued 
development and implementation of modern and progressive work practices to facili- 
tate and improve employee performance and the efficient accomplishment of the op- 
eration of the Government.” See VA Dir. 5023 § 2(b). Further, VA Directive 5023 
provides that “VA management shall carry out its duties in a manner consistent 
with the terms and spirit of human resources policies, principles and procedures 
that encourage the highest standard of employee performance and the most 
efficient accomplishment of VA operations.” Id. § 2(c) (emphasis added). Thus, 
the VBA violates its own policy by promoting a working culture that discourages 
the highest standard of employee performance so as to more expeditiously process 
claims. Moreover, the VBA further violates its policy respecting the efficient accom- 
plishment of VA tasks by promoting a culture that likely results in more claims de- 
cisions that are vulnerable to reversal on appeal and re-processing on remand — a 
less efficient manner of proceeding. 

Second, as set forth in Article 7 § 1 of the Master Agreement, “[s]ervice to the 
veteran is the cornerstone of the relationship between the Department and employ- 
ees,” and the “parties recognize the importance of a strong commitment to a com- 
prehensive Total Quality Improvement Program (TQI) in the Department.” (Em- 
phasis added). Thus, discouraging quality reviews of benefits claims in the name 
of processing a greater quantity of benefits claims violates the service-to-the-vet- 
eran imperative that is to inform the work of both the Department and its employ- 
ees and ignores the importance of quality considerations to the reviews under- 
taken — both of which violate the letter and spirit of Article 7 § 1 of the Master 
Agreement. (See also Am. Art. 26 § 1(A) (“The Department will strive for continuous 
improvement in performance to fulfill the Department’s commitment to providing 
quality customer service.”) (emphasis added); Agreement Between Dep’t of Vet- 
erans’ Affairs Cleveland Regional Office and AFGE Local 2823 [hereafter “Local 
Agreement” or “LA”] § 1(A) (“The mission of the Department of Veterans Affairs and 
this Regional Office is to service the veteran and beneficiaries with timely and 
quality service.”) (emphasis added).) Further, pursuant to Article 43 § 3(B) of the 
Master Agreement, management has an obligation to bargain locally with Local 
2823 as to, inter alia, the “methods and means of performing work.” Thus, by refus- 
ing to bargain over the Culture Claim, which is squarely addressed to the Cleveland 
VARO’s methods and means of performing work, the Cleveland VARO is abrogating 
this provision of the Master Agreement as well. 

Third, an atmosphere that promotes quantity at the expense of quality is fun- 
damentally contrary to the Department’s statutory obligations to improve the qual- 
ity of the claims rating process as well as increase the quantity of claims processed. 
See, e.g., 38 U.S.C. §7734(1)(E) (requiring an annual report to Congress that in- 
cludes, inter alia, “actions taken to improve the quality of services provided and 
the results obtained”) (emphasis added); id. §7734(2) (requiring an annual report to 
Congress that includes, inter alia, “information with respect to the accuracy of deci- 
sions, including trends in that information.”). 

C. Local 2823’s Culture Claim Has Evidentiary Support 

There is ample evidentiary support for Local 2823’s Culture Claim, both nation- 
ally and locally. 

First, recently completed national studies and surveys have confirmed the percep- 
tion among many claims ratings personnel nationwide that the Department has fos- 
tered an atmosphere in which quantitative objectives are pursued to the detriment 
of qualitative objectives. For example, in a recent report issued by the Veterans’ Dis- 
ability Commission in October 2007, they noted the following: 

In respect of the criticism concerning balancing quality and quantity in em- 
ployee performance, CNAC 7 discovered there exists a perception that VA 


7 “CNAC” is a shorthand reference to the CNA Corporation, which conducted scientifically 
valid and reliable surveys. See 10/07 VDBC Report at 19 (“The Commission also examined the 
results of studies undertaken on its behalf by the CNA Corporation (CNAC). . . . Additionally, 

Continued 
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emphasized quantity over quality. In a national survey, 80 percent 
of raters said having enough time to process a claim was one of their 
top three challenges. They were also asked to rate the availability of time 
to decide a claim, 54 percent of raters said availability of time was fair or 
poor. It can be argued that this creates incentives for RVSRs to make deci- 
sions that are not always fully backed by evidence, which leads to more ap- 
peals, and remands, and increases backlogs in the system. . . . 

* * * 

CNAC believes that the VA’s training difficulties are made exponentially 
worse because staff feel a need for more training and that training 
seems to be sacrificed to meet work quotas. This emphasis has encour- 
aged a high staff turnover at VA. The quality of claims is lessened since 
inexperienced individuals are taking over for experienced raters. 

Veterans Disability Benefits Comm’n, Honoring The Call To Duty: Veterans’ Dis- 
ability Benefits In The 21st Century [hereafter, “10/07 VDBC Report”] 342 (Oct. 
2007) (emphasis added). 8 

Moreover, in recent testimony to Congress, the Deputy Under Secretary for Bene- 
fits, Michael Walcoff, acknowledged that current quantitative measures of produc- 
tivity, which do not take into account the complexity of benefits claims and numbers 
of issues raised by a claimant, are in need of revision: 

To further enhance our ability to monitor performance, the study team rec- 
ommends the creation of a performance measurement system focused on 
tracking the number of medical disabilities or issues claimed. IBM believes 
that this issue-based performance measurement system, in conjunction with 
the existing claim-based performance measurement system, will result in a 
more accurate and detailed measure of productivity and workload. Under 
the current claim-based performance measurement system, a re- 
gional office is given the same credit for completing a claim with 
one issue as a claim with forty issues. The study team believes that 
measuring work output by both number of claims and number of issues at 
an organizational level is a more accurate assessment of a regional office’s 
productivity. In addition, an issued-based performance measurement at an 
individual level will provide more specificity in the activities of staff and 
result in increased accountability overall, rf] VBA agrees with the idea 
of adding an issue-based performance measurement system to our 
current reporting structure. 

February 18, 2008 Statement of Michael Walcoff Before The House Committee On 
Veterans’ Affairs Subcommittee On Disability Assistance And Memorial Affairs, Ex- 
amining The VA Claims Processing System (emphasis added). 

Second, in addition to such national evidence supporting Local 2823’s Culture 
Claim, Local 2823 will be prepared at the arbitration hearing to present evidence 
of specific instances of actions taken by Cleveland VARO management contributing 
to the establishment and promotion of a culture in which the quantity of ratings 
decisions is valued to the detriment of quality. For example, VSR production stand- 
ards at the Cleveland VARO are set at 10 points per day, 25 percent higher than 
the national standard of 8 points per day. Also, rating specialists at the Cleveland 
VARO only receive production credit for cases they have decided, and not for review- 
ing cases that are sent back to VSRs for further development. This means that 
RVSRs are incentivized to decide cases without correcting errors in the file instead 
of “losing time” while they rework cases that are procedurally or developmentally 
flawed. 


CNAC surveyed VA raters, service officers from veterans service organizations, and disabled vet- 
erans and survivors. These surveys were scientifically valid and reliable.”). 

8 Local 2823 further notes that it believes the failure of the Cleveland VARO to share the re- 
sults of the aforementioned study with Local 2823 was a violation of Master Agreement Article 
46 § 8(C), which on relevant part provides that “[i]f a third party conducts a survey and the 
results are distributed to the Department, the results will be shared with the Union.” See also 
Dep’t. of Veterans Affairs (VA) FY2007 Performance and Accountability Report [hereafter, “11/07 
VA Report”] 78 (Nov. 15, 2007) (“The Veterans’ Disability Benefits Commission began work in 
May 2005 and issued its report in October 2007. VA will study the Commission’s recommenda- 
tions and begin taking appropriate actions in 2008.”). 
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D. Local 2823’s Clarified and Revised Information Requests Addressed to 
the Culture Claim are Proper 

In addition, as noted in the Grievance, Local 2823 requests information from the 
Cleveland VARO that is normally maintained, reasonably available, and necessary 
for Local 2823 to fulfill its representational functions and responsibilities with re- 
spect to the prosecution of the Culture Claim, and, to that end clarifies and revises 
its requests for information, hereby requesting production of the following informa- 
tion created on or after January 20, 2000: 

• Any communications between and among Cleveland VARO management and 
supervisors respecting efforts to achieve quantitative production requirements; 

• Any communications between and among Cleveland VARO supervisors and em- 
ployees respecting efforts to achieve quantitative production requirements; 

• Documents sufficient to identify the numbers of employees who have received 
awards, bonuses, and/or promotions for achieving or exceeding quantitative pro- 
duction requirements; 

• Documents sufficient to identify the numbers of supervisors who have received 
awards, bonuses, and/or promotions for achieving or exceeding quantitative pro- 
duction requirements; 

• Documents sufficient to identify the numbers of employees (if any) who have re- 
ceived awards, bonuses, and/or promotions for achieving or exceeding quali- 
tative performance standards; 

• Documents sufficient to identify the numbers of supervisors (if any) who have 
received awards, bonuses, and/or promotions for achieving or exceeding quali- 
tative performance standards; 

• Documents sufficient to identify the number of employees who have received de- 
motions, non-satisfactory ratings, or other disciplinary actions or negative per- 
formance ratings for their failure to achieve or exceed quantitative production 
requirements; 

• Documents sufficient to identify the number of supervisors who have received 
demotions, non-satisfactory ratings, or other disciplinary actions or negative 
performance ratings for their failure to achieve or exceed quantitative produc- 
tion requirements; 

• Documents sufficient to identify the number of employees (if any) who have re- 
ceived demotions, non-satisfactory ratings, or other disciplinary actions or nega- 
tive performance ratings for their failure to achieve or exceed qualitative per- 
formance standards; 

• Documents sufficient to identify the number of supervisors (if any) who have 
received demotions, non-satisfactory ratings, or other disciplinary actions or 
negative performance ratings for their failure to achieve or exceed qualitative 
performance standards; 

• Any communications from employees in the Cleveland VARO to supervisors or 
other Cleveland VARO management complaining about quantitative production 
requirements and their effect on the quality of the claims processing; 

• Any communications from supervisors in the Cleveland VARO complaining 
about quantitative production requirements and their effect on the quality of 
the claims processing; 

• Any statistical information tracking the quantitative performance of the Cleve- 
land VARO in terms of processing clams; 

• Any statistical information tracking the quality of the Cleveland VARO in terms 
of processing claims; and 

• Any statistical information respecting the number and rate of Cleveland VARO 
claims determinations that are reversed or remanded on appeal. 

Moreover, it is plain that such information respecting the treatment of employees 
and supervisors with respect to the achievement of quantitative production require- 
ments as compared to the treatment of employees and supervisors with respect to 
the achievement of qualitative performance standards is both relevant and nec- 
essary to understand and assess the working culture created by management favor- 
ing quantitative attainments over qualitative achievements. (See MA at 177 (Art. 
46 ) § 5 (“The Department agrees to provide the Union, upon request, with informa- 
tion that is normally maintained, reasonably available, and necessary for the Union 
to effectively fulfill its representational functions and responsibilities. This informa- 
tion will be provided to the Union within a reasonable time and at no cost to the 
Union.”).). See also AFGE Local 1345 v. Fed’l Labor Relations Auth., 793 F.2d 1360 
(DC Cir. 1986) (Union entitled under 5 U.S.C. §7114 to obtain information regard- 
ing two employees who had been dismissed from jobs within union’s bargaining unit 
upon request for information from employer, as union’s status as bargaining rep- 
resentative required it to have access to information to assess its responsibility, in- 
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eluding information regarding dismissal of unit employees). 9 Thus, Local 2823 ex- 
pects to use the aforementioned information to evidence a consistent and long- 
standing emphasis on and encouragement of the attainment of quantitative produc- 
tion, with little or no concomitant emphasis or regard for the attainment of quali- 
tative performance standards. 

3. The Training Claim 

As set forth in the Grievance, management has: (1) failed to honor its commit- 
ment “to a standard of excellence in the quality and quantity of training for all em- 
ployees” (1/20/00 MOU '|| 2), “as evidenced by the low pass rates of employees on pre- 
vious tests and great disparities between . . . veterans served by different regional 
offices”; (2) failed “to provide training that significantly furthers the employee’s 
knowledge, skills and abilities to serve veterans”; (3) provided “ongoing training that 
. . . bears little resemblance to the training described in the January 20, 2000 
MOU”; (3) failed to rotate employees in a manner that would enable them “to gain 
and maintain proficiency in all aspects of their job”; (4) disadvantaged employees 
seeking promotion by failing to adequately train them to process claims, thereby 
preventing them from successfully competing for and obtaining promotions, bonuses, 
awards, advances, and other merit-based compensation and/or benefits. (GRV at 2- 
3«5(d), (1), (2), (3), 5(e).) 

A. The Training Claim is Sufficiently Particular 

For the same reasons that Local 2823’s Culture Claim has been stated with suffi- 
cient particularity in the Grievance, its Training Claim has been stated in a suffi- 
ciently particular manner. Again, your office’s Memorandum does not identify any 
authority requiring a more particularized statement of the facts underlying the 
Training Claim at this juncture, and we are aware of none. 

B. The Training Claim is Based on Violations of Applicable VA Policies 

and/or Agreements 

Like the Culture Claim, Local 2823’s Training Claim is based on violations of VA 
policies, applicable agreements, and applicable law. 

First, as noted by Deputy Under Secretary for Benefits, Ronald R. Aument, in 
a statement to Congress last October, training is important, because “[cjritical to 
improving claims accuracy and consistency is ensuring that our employees receive 
the essential guidance, materials, and tools to meet the ever-changing and increas- 
ingly complex demands of their decision-making responsibilities.” October 16, 2007 
Statement of Ronald R. Aument, Deputy Under Secretary For Benefits, Before The 
House Veterans’ Affairs Subcommittee On Oversight And Investigations [hereafter, 
10/16/07 Aument Testimony], As summarized by Under Secretary Aument, the 
training regimen that the VA is supposed to follow is intended to be centralized, 
standardized, and comprehensive: 

[1] New hires receive comprehensive training and a consistent foundation 
in claims processing principles through a national centralized training pro- 
gram called “Challenge.” [2] After the initial centralized training, employees 
follow a national standardized training curriculum (full lesson plans, hand- 
outs, student guides, instructor guides, and slides for classroom instruction) 
available to all regional offices. Standardized computer-based tools have 
been developed for training decision-makers (71 courses completed and an 
additional 5 in development). Training letters and satellite broadcasts on 
the proper approach to rating complex issues are provided to the field sta- 
tions. [31 In addition, a mandatory cycle of training for all Veterans Service 
Center employees has been developed consisting of an 80-hour annual cur- 
riculum. 


9 While the Memorandum asserts that such information requests need be answered only inso- 
far as the requirements of 5 U.S.C. §7114 are met, contending that Article 46 §5 of the Master 
Agreement merely restates 5 U.S.C. §7114, section 5 does not so state, nor is its text as limited 
as the provisions of 5 U.S.C. §7114 that are addressed solely to data “which is reasonably avail- 
able and necessary for full and proper discussion, understanding, and negotiation of subjects 
within the scope of collective bargaining.” Cf. NAGE Local R14-143 , 55 FLRA 317 (1999) (Chair 
Segal, Concurring & Dissenting In Part) (dissenting from majority finding that Union conceded 
statutory and contractual rights were the same, noting that “such concession appears particu- 
larly unlikely in view of the fact that Article 11 makes no reference to, and does not otherwise 
restate, the Statute”) (noting that where provision merely reiterates statute, then authority need 
only take care to assure that contractual interpretation is not inconsistent with statute). We fur- 
ther note that even if the Cleveland VARO had legitimate grounds to withhold some of the infor- 
mation requested, that does not mean it can withhold all information requested. See generally 
AFGE Local 2263 v. Fed’l Labor Relations Auth., 454 F.3d 1101 (10th Cir. 2006). 
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10/16/07 Aument Testimony. And the VA’s most recent annual report again reiter- 
ates that “[t]raining remains a priority. ...” 11/07 VA Report at 199. But notwith- 
standing these published policies and statements, and as set forth below, Local 2823 
has reason to believe that the training provided by the Cleveland VARO: (1) does 
not provide new hires with “comprehensive training and a consistent foundation in 
claims processing principles”; (2) does not assure that incumbent employees follow 
a “national standardized training curriculum” that is made equally and fully avail- 
able to all within the Cleveland VARO; and (3) does not assure that all employees 
receive the full cycle of training and complete an 80-hour curriculum each year. 

Second, the applicable agreements similarly make clear that training is critical 
and the Department is responsible for providing it on a fair and equitable basis. 
Specifically, Master Agreement Article 34 § 1(A) provides as follows: 

The Department and the Union agree that the training and development 
of employees is of critical importance in carrying out the mission of the De- 
partment. In recognition of this, the Department will provide training 
and career development opportunities to employees of the bargaining unit. 

The Department is responsible for ensuring that all employees receive the 
training necessary for the performance of the employees’ assigned duties. 

(MA at 142 (Art. 34) § 1(A) (emphasis added).) Moreover, the Master Agreement re- 
quires fair and equitable administration of training among employees. (See, e.g., MA 
at 143 (Art. 34) §3(0 (“When resources for training are limited, approval for 
training funds will be based on fair criteria that are equitably applied.”) 
(emphasis added).) Further, the Master Agreement requires the Department to in- 
form employees, at least annually, about training opportunities, policies, and nomi- 
nation procedures. (See id. at 143 (Art. 34) § 6(A) (“The Department shall inform 
employees, at least annually, about Department training opportunities, policies, and 
nomination procedures. Upon request, the Department will advise individual em- 
ployees of training opportunities that meet identified educational or career objec- 
tives.”). Finally, and perhaps most importantly, the Master Agreement makes clear 
that such training matters are appropriate subjects for local bargaining, stating: 
“[p]rocedures which ensure fair and equitable training opportunities are appro- 
priate subjects for local bargaining (MA at 144 (Art. 34) §9 (emphasis 
added). 10 ) 

Yet once again, as set forth below, Local 2823 has reason to believe that the 
Cleveland VARO is not honoring its training and bargaining obligations under the 
Master Agreement, inasmuch as the Cleveland VARO: (1) has not provided training 
and career development opportunities to all employees; (2) has not ensured that all 
employees have received the training necessary for the performance of their as- 
signed duties; (3) has not used fair criteria, equitably applied, to assure that train- 
ing is appropriately distributed among and between employees; (4) has not advised 


10 See also MA at 172 (Art. 44) §4(A) (“On all policies and directives or other changes for 
which the Department meets its bargaining obligation at the national level, appropriate local 
bargaining shall take place at individual facilities and may include substantive bargaining that 
does not conflict with negotiated national policy and agreements.”); id. at 172-73 (Art. 44) § 4(B) 
(“Proposed changes in personnel policies, practices, or working conditions affecting the interests 
of one local Union shall require notice to the President of that local. Proposed changes in per- 
sonnel policies, practices, or working conditions affecting the interests of two or more local 
Unions within a facility shall require notice to a party designated by the NVAC President with 
a copy to the affected local Unions. Proposed changes in personnel policies, practices, or working 
conditions affecting the interests of more than one facility shall require notice to a party des- 
ignated by the national VA Council President.”); id. at 169 (Art. 43) §1 (“Recognizing that the 
Master Agreement cannot cover all aspects or provide definitive language for local adaptability 
on each subject addressed, it is understood that Local Supplements may include substantive bar- 
gaining on all subjects covered in the Master Agreement so long as they do not conflict, interfere 
with, or impair implementation of the Master Agreement. However, matters that are excluded 
from Local Supplemental bargaining will be identified within each Article.”) (emphasis 
added); id. §2(A) (“The Local Supplemental Agreement may cover all negotiable matters regard- 
ing conditions of employment insofar as they do not conflict with the Master Agreement as de- 
fined in Section 1. . . . Note: This is not intended to preclude local bargaining of items that 
are not covered by the Master Agreement, i.e., policies, procedures and directives initiated at 
the facility level or national level”) {emphasis added); id. §2(B) (“In the event either of the 
national parties determines there exists a conflict with the Master Agreement, they shall for- 
ward a written document to the respective local and the other national party identifying the 
conflict for resolution at the local level.”). These provisions of the Master Agreement and similar 
provisions in the 1/20/00 MOU make clear that contrary to the assertions in the Memorandum 
(see Mem. at 2—3 < I‘l[5(a)-(c)), the VA’s belief that it has met its bargaining obligations at the 
national level do not relieve it of the obligation to bargain locally as to the matters put at issue 
by Local 2823’s Grievance. 
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individual employees who request such information of training opportunities that 
meet identified educational or career objectives, including, but not limited to, VSR 
and/or RVSR certification; and (5) has refused to bargain with Local 2823 to ensure 
that fair and equitable training opportunities are made available to all employees. 

Moreover, as regards training related to certification of VSR and RVSR personnel, 
the parties 1/20/00 MOU provides that the Department has a number of obligations, 
relating to training, reciting in relevant part the following: 

• “VBA commits to a standard of excellence in the quality and quantity of train- 
ing for all employees. We will ensure training programs, which are the core and 
prerequisite to certification, are complete and sufficient to provide employees 
the necessary tools to become certified. There will be a direct relationship be- 
tween the training program and certification.” (1/20/00 MOU 12 (emphasis 
added)). 

• “Employees will proceed through standardized training such as the TPSS 
program, which may include pre and post tests for the purpose of determining 
the efficacy of training. Training will include mentoring, on-the-job-training 
and ongoing feedback.” (1/20/00 MOU 13 (emphasis added).) 

• “Where incumbent employees have not been performing the full range of duties 
due to specialization or for other reasons, at the employees request, we will en- 
sure that they are provided training sufficient for them to participate in 
the certification program.” (1/20/00 MOU 16 (emphasis added).) 

• “A copy of this MOU will be furnished to the Local President of all VBA facili- 
ties represented by AFGE. Local unions will be given the opportunity to bar- 
gain over appropriate issues not otherwise in conflict with this or other national 
level agreements, prior to local implementation.” (1/20/00 MOU 1 10 (emphasis 
added).) 

However, once again, as set forth below the Cleveland VARO has violated its obli- 
gations under the 1/20/00 MOU, because: (1) the quality and quantity of training 
made available to employees does not rise to the promised standard of excellence; 
(2) training programs are not complete and sufficient to provide employees the nec- 
essary tools to become certified; (3) employees have not proceeded through standard- 
ized TPSS training, and the training generally has not included mentoring, on-the- 
job training or ongoing feedback; (4) incumbent employees who have not been per- 
forming the full range of duties due to specialization or other reasons have not been 
provided training sufficient for them to participate in the certification program; and 
(5) management has failed and refused to bargain over these issues. 

Finally, it is important to note that while your office’s Memorandum asserts that 
it is not obligated to bargain with Local 2823 regarding these training matters relat- 
ing to VSR and RVSR certification in light of certain alleged positions taken by the 
national Union in negotiations with the Department, those assertions ignore the 
facts that: (1) the matters for which Local 2823 has sought to bargain are not the 
same as those put at issue by the dispute at the national level (and the Memo- 
randum makes no attempt to explain why they are); (2) regardless of the resolution 
of VA’s dispute with the national Union, that will not resolve the training issues 
for which Local 2823 has sought to bargain locally; (3) the Memorandum’s asser- 
tions regarding the exclusive recognition of the national Union ignore that the De- 
partment agreed with the national Union that local bargaining would still occur and 
the appropriate VARO would still be obligated to engage in such local bargaining 
pursuant to the applicable provisions of the Master Agreement. 11 

C. The Training Claim Has Evidentiary Support 

Once again, there is ample evidentiary support for Local 2823’s Training Claim, 
both nationally and locally. 

First, both the Office of the Inspector General and third-party studies have found 
that disparities in training across offices account for at least some of the differences 


11 We further note in this regard that the Memorandum’s citation to U.S. Food & Drug Adm., 
Northeast & Mid-Atl. Regions v. AFGE Council No. 242, 53 F.L.R.A. 1269 (1998) is misplaced 
and in fact supports Local 2823’s position here. Notably, in relevant part U.S. Food & Drug 
states, “[a] representative with a collective bargaining relationship in a consolidated bargaining 
unit is not required to bargain locally with individual components that make up the consolidated 
unit unless such bargaining has been agreed to at the consolidated level.” Id. at 1274 
(emphasis added); id. (“Parties to a national, consolidated bargaining unit may, and often do, 
authorize local components to bargain supplemental and other agreements over particular sub- 
jects or in particular circumstances.”). And here, it is plain that in the Master Agreement and 
1/20/00 MOU, the Department and national Union agreed that local bargaining would continue 
to be available unless expressly proscribed by the Master Agreement. See supra n.9. 
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across offices with respect to the average amount of compensation awarded to a 
claimant. For example, the Deputy Inspector General, in a statement to Congress, 
represented that “the degree of rater subjectivity can be influenced by . . . the 
amount of training and rater experience.” October 16, 2007 Statement Of Jon A. 
Wooditch, Deputy Inspector General, Before The Subcommittee On Oversight And 
Investigations Committee On Veterans’ Affairs — U.S. House Of Reps. Hrng On Dis- 
ability Claims Ratings & Benefits Disparities Within The VBA [hereafter, “10/16/ 
07 Wooditch Testimony”]. Moreover, variations in training across offices also were 
identified by the Institute for Defense Analyses (“IDA”) in its study, Analysis of Dif- 
ferences in VA Disability Compensation (hereafter, the “IDA Study”), as a significant 
factor responsible for differences in compensation awarded across offices. See, e.g., 
Hope Yen, AP, Washington Post (July 19, 2007) (“But the study released to AP 
found that roughly one-third of the problems could be blamed on poor VA standards 
and inadequate training.”). 12 Indeed, one of the recommendations of the IDA Study 
was to “[standardize initial and on-going training for rating specialists” 10/16/07 
Aument Testimony. Thus, this national evidence suggests that the Cleveland VARO 
is not receiving training commensurate with that made available to raters in other 
offices. 

Moreover, the current insufficiency of training programs and policies has been 
confirmed by the recent report of the Veterans’ Disability Benefits Commission, 
which states: 

VBA regional office staff must receive adequate education and training. 
Quality reviews should be performed to ensure these frontline workers are 
well versed to rate claims. Adequate resources must be appropriated to hire 
and train these workers to achieve a manageable claims backlog. 

(10/07 VDBC Report 338 (Recommendation 9.5).) 

Second, as set forth in the Grievance, there are numerous instances of the Cleve- 
land VARO failing to implement equitably, promptly, and appropriately training. 
For example, as a result of the Claims Process Improvement teams that have been 
formed to focus on specific problem areas, employees are not cycled through all 
areas and do not receive on-the-job training in many areas before they are required 
to sit for certification exams covering all areas. (See GRV at 2 §5(3).) Moreover, 
training that has been provided has not been comprehensive, but instead has largely 
been addressed to the specific tasks assigned an employee at the time of hire. (See 
id.) The initial training for VSRs in the Cleveland VARO is focused on the tasks 
performed by the team to which the VSRs have been assigned, either pre-develop- 
ment or post-determination. Then, 85 percent-90 percent of the training that the 
VSRs receive on the job consists of overview courses that also cover tasks they per- 
form in their current jobs. This training regimen leaves VSRs unprepared for their 
new duties when they switch teams and the quality of their work (and their produc- 
tion) suffers. In addition to these problems with VSR training, the Cleveland VARO 
also fails to train RVSRs appropriately. At the time the grievance was filed, few 
RVSRs in the office had completed the TPSS training modules that are required for 
first-year rating specialists. Instead of addressing this deficiency, the Cleveland 
VARO ignores it: three rating specialists were promoted in October 2007, even 
though they had failed to complete the basic compensation training module. 

D. Local 2823’s Clarified and Revised Information Requests Addressed to 
the Training Claim are Proper 

In addition, as noted in the Grievance, Local 2823 requests information from the 
Cleveland VARO that is normally maintained, reasonably available, and necessary 
for Local 2823 to fulfill its representational functions and responsibilities with re- 
spect to the prosecution of the Training Claim, and, to that end clarifies and revises 
its requests for information, hereby requesting production of the following informa- 
tion created on or after January 20, 2000 (except as otherwise indicated): 

• Documents sufficient to show the number of employees (including VSRs and 
RVSRs) who have received training in the Cleveland VARO, the amount of 
training that they have received, and the types of training that they have re- 
ceived in each of the fiscal years 2002, 2003, 2004, 2005, 2006, 2007, and 2008 
(to date); 

• Documents sufficient to show all plans and programs for training employees (in- 
cluding VSRs and RVSRs) at the Cleveland VARO or elsewhere for the fiscal 
years 2002, 2003, 2004, 2005, 2006, 2007, and 2008 (to date); 


12 The IDA study does not appear to be publicly available at this juncture. 
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• All communications from employees complaining, praising or otherwise evalu- 
ating the amount, content, type, availability, or other aspects of training pro- 
vided or made available to employees; 

• All studies, audits, and/or investigations by the VA and/or third parties (includ- 
ing, but not limited to, the IDA Study) addressing the adequacy of training 
made available to and/or required of employees at the Cleveland VARO and na- 
tionally (including, but not limited to, VSRs and RVSRs); 

• Documents sufficient to show all training that is required and/or suggested for 
VSR and/or RVSR certification, including, but not limited to, copies of instruc- 
tions for RVSR and/or VSR national training requirements; 

• Documents sufficient to show all on-the-job training accomplished and its rela- 
tionship to certification of VSRs and/or RVSRs; 

• A copy of the curriculum formally identified as VSR “Readiness Training”; 

• A copy of any training materials respecting “the Candidate Guide”; 

• A copy of any “Boot Camp” test or similar Cleveland VARO practice test; 

• A copy of all materials found at the following website address: http:/ / 
cptraining.vba. va.gov I C&PTraining / VSR / VSRCerTng / 
VSRCertCurriculum.htm; 

• A copy of the link to the VSR Certification Training Guide that has been pro- 
vided to each employee in the Cleveland VARO who is eligible for certification; 
and 

• A copy of all materials found at the following website address: http :/ / 
cptraining.vba.va.gov / C&PTraining /VSR / VSRCertTng / Documents / 
VSRCertTrainingGuide.pdf. 

Further, it is plain that production of the requested training information is rel- 
evant and necessary to Local 2823’s prosecution of its Training Claim, as the infor- 
mation will be used to establish the specific departures of the Cleveland VARO from 
applicable training requirements, agreements, and policies. 

4. The Performance Appraisal Claim 

In light of the foregoing, and as set forth in the Grievance, “management has ab- 
rogated its duty to maintain a fair and impartial performance appraisal system 
under multiple sections of Master Agreement 26,” and has otherwise abrogated VA 
policy and guidance in its application of the existing performance appraisal system. 
(GRV at 4 1 6(a).) 

A. The Performance Appraisal Claim is Sufficiently Particular 

For the same reasons that Local 2823’s Culture and Training Claims have been 
stated with sufficient particularity in the Grievance, Local 2823’s Performance Ap- 
praisal Claim has been stated in a sufficiently particular manner. Again, your of- 
fice’s Memorandum does not identify any authority requiring a more particularized 
statement of the facts underlying the Performance Appraisal Claim at this juncture, 
and we are aware of none. 

B. The Performance Appraisal Claim is Based on Violations of Applicable 

VA Policies and/or Agreements 

Local 2823’s Performance Appraisal Claim is based on violations of applicable VA 
policies and/or agreements. 

First, as set forth in VA Directive 5023, “[t]he public interest demands the high- 
est standards of employee performance and the continued development and imple- 
mentation of modern and progressive work practices to facilitate and improve em- 
ployee performance and the efficient accomplishment of the operation of the Govern- 
ment.” See VA Dir. 5023 §2(b). Further, as VA Directive 5023 also states, ‘VA man- 
agement shall carry out its duties in a manner consistent with the terms and spirit 
of human resources policies, principles and procedures that encourage the highest 
standard of employee performance and the most efficient accomplishment of VA op- 
erations.” See id. § 2(c) (emphasis added). 

Management has abrogated both of these VA imperatives, however, by imple- 
menting a performance appraisal system that, for the reasons set forth above and 
below: (1) does not promote the “highest standards of employee performance and the 
continued development and implementation of modern and progressive work prac- 
tices to facilitate and improve employee performance and the efficient accomplish- 
ment of’ VA operations; and (2) is fundamentally inconsistent “with the terms and 
spirit of human resources policies, principles and procedures that encourage the 
highest standard of employee performance and the most efficient accomplishment 
of VA operations.” 
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Second, as noted in the Grievance, management’s implementation of the existing 
performance appraisal system also contravenes applicable provisions of Article 26 of 
the Master Agreement. Specifically, the relevant provisions of Article 26 (as amend- 
ed) that are abrogated by management’s implementation and application of the ex- 
isting performance appraisal system include the following: 

• “In its entirety and application, the performance appraisal process will to the 
maximum extent feasible, be fair, equitable, and strictly related to job 
performance as described by the employee’s job description.” TAm. Art. 26 
§ 3(A) (emphasis added).] 

• “Performance appraisals shall be fair and objective.” [Id. §3(C) (emphasis 
added)] 

• “The union may provide input into any changes to performance standards and/ 
or establishment of new performance standards.” [Id. § 5(A).] 

• “Performance standards and elements to the maximum extent feasible shall be 
reasonable, realistic, attainable, and sufficient under the circumstances 
to permit accurate measurement of an employee’s performance, and adequate 
to inform the employee of what is necessary to achieve a ‘Fully Successful’ level 
of achievement.” I Id. § 5(C) (emphasis added).] 

• “The Union shall be given reasonable written advance notice . . . when Manage- 
ment changes, adds to, or establishes new elements and performance standards. 
Prior to implementation of the above changes to performance standards, man- 
agement shall meet all bargaining obligations.” [Id. § 5(E).] 

• “Normally, elements are not weighted or assigned different priorities. However, 
the Department will inform the employee, at the time the elements and stand- 
ards are communicated, whether aspects of any job elements are to be ac- 
corded different priority. If the elements, standards, or priority changes, that 
change(s) will be communicated to the employee when it becomes effective.” [Id. 
§ 5(H).] 

Notwithstanding these obligations, however, management has breached the fore- 
going provisions of Article 26 of the Master Agreement by, inter alia : (1) applying 
the existing performance appraisal system in a manner that is unfair, inequitable, 
and almost exclusively related to the achievement of quantitative production tar- 
gets; (2) establishing certification and related requirements that are now part of the 
performance appraisal while refusing any input from Local 2823 respecting the con- 
tent and implementation of the same; (3) failing to give reasonable written advance 
notice to Local 2823 respecting the implementation of newly established certification 
and related training requirements; (4) weighting quantitative production measures 
more highly than accuracy measures without formally apprising employees of the 
same; (5) utilizing statistical production data to evaluate individual performance in 
a manner that is unreliable, invalid, unfair and inequitable because it fails to take 
into account the number of issues raised by claims and the complexity of the claims 
process. 

C. The Performance Appraisal Claim has Evidentiary Support 

Like its other claims, Local 2823’s Performance Appraisal Claim also is amply 
supported both nationally and locally. 

First, as adverted to in Deputy Under Secretary WolcofPs recent testimony to 
Congress this past February, even independent third-party consultants have found 
problematic the existing performance appraisal system’s use of quantitative produc- 
tion criteria that fail to account for the numbers of issues raised and complexity of 
claims. (See 2/14/08 Walcoff Testimony.) And, perhaps more importantly, in testi- 
fying before Congress, the Veterans’ Benefits Administration (“VBA”) has stated 
that it “agrees with the idea of adding an issue-based performance measurement 
system to our current reporting structure.” (Id.) Further, as noted above, the Vet- 
erans’ Disability Benefits Commission similarly found that greater attention to qual- 
ity should be paid in assessing the performance of employees. (See 10/07 VDBC Re- 
port 338.) 

Second, in terms of the Cleveland VARO, the existing performance appraisal sys- 
tem applied by management again penalizes raters who take the time to assure ac- 
curate ratings of multi-issue and complex claims and favors those who are less accu- 
rate but meet or exceed applicable production quotas. For example, a case with a 
minimal amount of evidence, such as a well-documented knee injury, is given the 
same production credit as a multi-volume multi-issue case for PTSD. Raters are 
therefore tacitly (and sometimes overtly) encouraged to avoid processing difficult 
claims. A different problem is the older case whose record has been developed in 
several stages and requires follow-up with several treating physicians. If an RVSR 
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spends 1 hour with the case and discovers that a private treatment record identified 
by the veteran is missing, the RVSR should defer a decision on that case. The 
RSVR, however, does not receive any production credit under the performance plan 
for deferring this decision. Instead, the performance plan gives the RVSR the stark 
choice of ignoring the missing evidence and deciding the case or (correctly) deferring 
the case and absorbing the entire time spent with that case as lost. 

D. Local 2823’s Information Requests Addressed to the Performance Ap- 
praisal Claim are Proper 

In addition, as noted in the Grievance, Local 2823 requests information from the 
Cleveland VARO that is normally maintained, reasonably available, and necessary 
for Local 2823 to fulfill its representational functions and responsibilities with re- 
spect to the prosecution of the Performance Appraisal Claim, which requests are en- 
compassed by the requests set forth above with respect to the Culture and Training 
Claims. Again, the requested information is both relevant and necessary, as it will 
be used by Local 2823 to assess the manner in which the existing performance ap- 
praisal system has been applied by the Cleveland VARO and to demonstrate the 
ways in which the current system violates VA policy and provisions in Article 26 
of the Master Agreement. 

5. The Veterans’ Disability Benefits Claims Modernization Act of 2008, H.R. 
5892 

Lastly, before closing, we wish to note that one of the reasons that Local 2823 
believes a meeting to discuss the parties’ differences is advisable at this juncture 
is that pending legislation may — at least in Local 2823’s view — moot many of these 
disputes. 

In particular, the Veterans’ Disability Benefits Claims Modernization Act Of 2008, 
H.R. 5892, 110th Cong. (2d Sess. 2008) (the “Proposed Legislation”) was referred to 
the House Committee on Veterans’ Affairs in April 2008, on July 29, 2008, an 
amended bill was favorably reported out of Committee to the House floor, and on 
July 30, 2008, the amended bill was passed by the House on a roll-call vote of 429- 
0. See 154 Cong. Rec. H7256-H7263 (daily ed. July 29, 2008); 154 Cong. Rec. H7518 
(daily ed. July 30, 2008). If enacted in its current form, the Proposed Legislation 
would: (1) require the Department to engage a third-party to annually assess the 
quality of claims processing across the VAROs (see Proposed Legislation § 106), 
thereby potentially addressing concerns giving rise to Local 2823’s Culture Claim; 
(2) require the Department to study and develop new certification standards and 
programs after obtaining appropriate input from employees and their representa- 
tives ( see id. § 105), thereby potentially addressing concerns giving rise to a portion 
of Local 2823’s Training Claim; (3) require the Department to study and evaluate 
training made available to employees (see id. § 106(a)(3)), thereby potentially ad- 
dressing concerns giving rise to another portion of Local 2823’s Training Claim; and 
(4) study and implement new performance standards that would place greater em- 
phasis on the quality of ratings decisions and less emphasis on the quantity of them 
(see id. § 103), thereby potentially addressing the concerns giving rise to Local 2823’s 
Performance Appraisal Claim. 13 

Accordingly, any information that management of the Cleveland VARO could pro- 
vide to Local 2823 respecting the Department’s position with respect to the Proposed 
Legislation — including whether the Department opposes, supports, or partially op- 
poses and partially supports the Proposed Legislation — would be beneficial. 

* * * 

Thank you for your prompt attention to the foregoing matters, and I look forward 
to a response from your office on or before September 15, 2008, so that the parties 
may quickly reach agreement on a date when representatives of management and 
Local 2823 may sit down together in Cleveland to further discuss (and hopefully re- 


13 Of course, the introduction of the Proposed Legislation merely confirms that Local 2823’s 
Culture, Training and Performance Appraisal Claims are well-founded and raise issues of con- 
cern that are shared by employees in other regional offices and Members of Congress. See, e.g., 
Statement of Congressman Hare In Support Of H.R. 5892, 154 Cong. Rec. H7262 (daily ed. July 
29, 2008) (“The largest factors contributing to the claims backlog are the broken culture and 
processes at the VA. There is a lack of accountability on raters, poor quality assurance 
measures , a broken work credit system , virtually no training for the VBA personnel, and 
an outdated information technology system. [*H] H.R. 5892 squarely addresses these problems 
by creating a more accountable and accurate system that rewards raters for the quality of their 
work, and it holds them accountable for their mistakes, ensuring that claims are processed cor- 
rectly the very first time.”) (emphasis added). 
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solve) the matters put at issue by Local 2823’s Grievance. Should I be able to an- 
swer any questions in the interim, please do not hesitate to contact me. 


Sincerely, 

cc: John A. Limposte, Assistant Director 


Jeffrey K. Lamb for Drew G.A. Peel 


Prepared Statement of Patricia A. Keenan, Ph.D., Program Manager, 
Human Resources Research Organization 

Good afternoon. I am Patricia Keenan, a Program Manager at the Human Re- 
sources Research Organization, known less formally as HumRRO. HumRRO is a 
non-profit, 501(c)3 research and development organization, established in 1951, that 
works with Government agencies and other organizations to improve their effective- 
ness through improved human capital development and management. 

I will comment today about the Compensation and Pension (C&P) Service’s train- 
ing program, as well as on methods to increase accountability and reduce rating 
variance. I am the project leader for HumRRO’s work with VBA’s Skills Certifi- 
cation program. 

Skills Certification Testing Program 

HumRRO’s has worked closely with C&P Service on Skills Certification program 
for Veterans Service Representatives (VSRs) and Rating VSRs (RVSRs). We began 
assisting VBA with the program in 2001, by developing the multiple-choice VSR test 
that is administered to GS-lOs seeking promotion to GS-11. In 2006 our work ex- 
panded to include VSRs at Pension Maintenance Centers (PMC) and RVSRs who 
have just completed training. Last year we began developing the Skills Certification 
test for journey-level RVSRs. 

The VSR test is completely operational with two administrations planned per 
year. Development of the RVSR end-of-training test is complete and the test is ex- 
pected to become operational in December of this year. Development of the PMC 
VSR test is also complete and is expected to become operational next spring. In the 
future, all Skills Certification tests will be administered via the Internet. This has 
the advantage of allowing us to expand the types of items on the test to include 
completion and short essay items. 

The tests were developed using a content-validation strategy, which requires that 
the tests reflect important job-related content. The first step in creating that link 
was to conduct job analyses for each of the four target positions. Subject matter ex- 
perts linked important tasks to the knowledges, skills and abilities required to per- 
form them. The number of tasks linked to a knowledge area is reflected in the 
weight given to that knowledge area of the test blueprint and to the number of 
items in that area that are on the test. To maintain the content validity of a test, 
it is necessary that job analyses be repeated periodically to ensure that the test still 
captures the important job requirements. Because the original VSR job analysis was 
conducted in 2001 and many characteristics of the job have changed since then, we 
conducted a new job analysis this year. We are in the final stages of revising the 
test blueprint for the VSR test. 

C&P Training Programs 

Since the Skills Certification program began in 2001, C&P Service has initiated 
several training programs. Newly hired or promoted VSRs and RVSRs are required 
to take centralized Challenge training. There is an RVSR Challenge course and sep- 
arate VSR Challenge courses for Pre-Determination and Post-Determination. All 
three Challenge courses include several Training Performance Support System 
(TPSS) modules. These are web-based training modules and electronic job aids with 
accompanying case-based performance practice and performance testing. The con- 
tent of the modules are content tailored to the specific position. Experienced deci- 
sion-makers also use the modules for refresher training. 

VSRs and RVSRs are also required to take 80 hours of refresher training per 
year. Central Office decides the appropriate content for 60 percent of this training 
(48 hours); the other 40 percent (32 hours) is determined by each Regional Office 
on an “ad hoc” basis. This mix ensures that training addresses areas recognized as 
requiring additional training both nationally and locally. Additional training may be 
required for several reasons — to disseminate information about new regulations or 
court decisions, to address areas that are commonly appealed, or to correct problems 
identified during Systematic Technical Accuracy Review (STAR) review. This re- 
fresher training is provided in several ways — via classroom training, satellite broad- 
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casts, net meetings, or online courses. VSRs who are preparing to take the Skills 
Certification Test also receive additional training time to prepare for the test. Please 
note that HumRRO has no role in preparing or delivering these training courses; 
our job is to help VBA by developing an independent assessment of knowledge nec- 
essary for the job itself. 

Training and Test Results 

As of August, 2008, 1,227 participants have passed the VSR Skill Certification 
test. The passing rates have risen steadily from 25 percent in the 2003 test to 49.58 
percent in August of this year. These rising passing rates for the VSR test indicates 
to us that training is having a positive effect on test performance. 

We asked participants in the May test which TPSS modules they had completed 
or used as reference. The three modules with the highest percentage of completion 
were Original Claim for Compensation , which 157 VSRs reported completing (33.12 
percent), Original Claim for Pension , which 127 respondents (26.7 percent), reported 
completing, and Dependency Benefits, which 118 VSRs (24.9 percent) reported com- 
pleting. The other modules were completed by 21 percent of test takers or less. The 
average number of modules completed was three. The general trend in the data 
shows that those who completed the TPSS modules had the highest scores, followed 
by those who did not use them at all (i.e., neither completed them nor used them 
as a reference), followed by those who used them only as a reference. Newer employ- 
ees were more likely to have completed the TPSS modules whereas employees with 
longer tenure were more likely to have used the TPSS modules as references. There 
was no correlation between the number of TPSS modules completed and total test 
score. 

Similarly, we asked participants in this summer’s RVSR end-of-training test 
which TPSS modules they completed. Candidates reported completing an average of 
6.7 out of 10 modules. Eighty-seven percent of respondents (re=334) said they had 
completed Rate an Original Claim for Disability Compensation-, 72.4 percent (n= 278) 
reported completing Rate an Original Claim for Disability Pension. Other modules 
were completed by 71 percent of respondents or fewer. There correlation between 
the number of TPSS modules completed and test score was significant (r(384)=.17, 
p=.001). Slightly more than 92 percent of respondents (n= 354) reported completing 
Challenge training. 

The field test for the PMC VSRs was conducted last week. The two TPSS modules 
completed by the largest percentage of the 60 participants were: Original Claim for 
Pension (n= 24; 40 percent) and Income Adjustments (n= 19; 31.7 percent). We will 
not be able to further analyze the data until scoring is completed in early October. 

Impediments to Rating 

As part of the job analyses required for test development, HumRRO staff con- 
ducted a series of visits to regional offices to learn more about the VSR and RVSR 
jobs. The main purpose of these site visits was to identify the critical job elements 
for incumbents. However, participants in focus groups and interviews also provided 
information about other aspects of their jobs. We talked with incumbent RVSRs, De- 
cision Review Officers, coaches and Service Center Managers. 

The rating process is cognitively complex, requiring the RVSR to compare the 
facts and medical evidence presented in the claim folder to the descriptions of level 
of disability found in 38 CFR, encompassing two widely differing bodies of knowl- 
edge. When the RVSR has completely reviewed the file, established that the veteran 
has a service-connected condition and all pertinent evidence has been included, the 
rater begins evaluation process. This is done by comparing the relevant facts pre- 
sented in the claims folder to the rating schedule, which is organized around 15 
body systems (e.g., endocrine, musculoskeletal, respiratory, mental disorders). Par- 
ticipants in the job analysis site visits cited being able to do this with relative ease 
is the major difference between trainee RVSRs and their journey-level counterparts. 
They indicated that trainee RVSRs often struggle with anatomy and understanding 
medical terms at first, then realize that applying the regulations, via the rating 
schedule, is actually the more challenging part of the job. 

The RVSR reviews the medical evidence for each separate condition being claimed 
and matches the condition to a diagnostic code in the rating schedule. These diag- 
nostic codes, in turn, are associated with descriptions for varying levels of severity 
of impairment. These levels are either assigned percentages in increments of 10 on 
a scale from 0 to 100 or, for some disabilities such as a muscle injury, they are eval- 
uated on more general descriptions such as severe, moderately severe, moderate, 
and slight. Thus the RVSR is first required to understand the medical condition(s) 
(e.g., body system affected, symptoms, severity, limitations thereof) and then to 
match that information to the correct section(s) of the rating schedule to determine 
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the level of disability for each condition. In addition, there are several factors that 
make the task even more demanding. These fall broadly into two categories: work- 
load and ambiguity. 

Workload Factors 

One of the recurring problems discussed by incumbents was that of incomplete 
cases and files. When the RVSR begins the adjudication process, the file should be 
ready for rating. However, they report that often they find the case requires addi- 
tional development, which the RVSR can do or defer back to the VSR. The problems 
are varied and range from an incomplete exam, missing justification for diagnosis, 
unclear information from the veteran that must be clarified, to service records that 
do not show sufficient information on which to establish service-connection. While 
these problems can all be resolved, doing the required additional development adds 
significantly to the time it takes to process a case. The RVSR has spent time review- 
ing a case that was not ready for a rating decision and the decision must wait until 
the information can be collected. 

A second problem is the sheer volume of cases awaiting adjudication. The backlog 
of work has been growing for years and is increasing more rapidly than ever with 
the influx of veterans from OEF/OIF. Veterans today file claims at the time of sepa- 
ration and a large proportion of cases contain multiple issues. A related factor is 
that often a veteran files additional claims before the first has been decided, with 
the result of holding up all of the veteran’s claims until they can be rated at once. 

VBA has addressed the workload problem by hiring several thousand VSRs and 
RVSRs in the past year. One result of this has been that newly hired RVSRs (and 
VSRs) do not understand the development process well, and often spend much of 
their time learning what makes a case “ready to rate.” While they will eventually 
become proficient rating specialists, they are less efficient than they might be due 
to lack of understanding of this vital component of claims processing. 

RVSRs also face conflicting demands for prioritizing their work. OIF/OEF cases 
are given priority, as are old cases, and those in which the veteran is facing finan- 
cial hardship or a terminal illness. Journey-level RVSRs often mentor less experi- 
enced RVSRs, reviewing their work and providing feedback, an additional duty in 
addition to their regular workload. 

Ambiguity 

Another common theme heard during the focus groups was that it is critical for 
RVSRs to understand that what they are rating is most often not black-and-white. 
There are gray areas in both the medical and legal aspects of the job. A good deal 
of research is often required to establish service-connection, verify stressors, and un- 
derstand the nature and severity of a medical condition. RVSRs have a large num- 
ber and variety of resources available to them to help gather this information, which 
they then compare to the regulations. However, even their best efforts often result 
in having to make evaluations based on incomplete medical and legal information. 

Inexperienced RVSRs usually take longer to rate a case than experienced raters. 
They are less comfortable making decisions without complete information, and com- 
paring the medical information to the regulations is not an exact science. RVSRs 
become more comfortable with this ambiguity over time. They also become more fa- 
miliar with the rating schedule, so they are able to use it with more ease and be- 
come more savvy in how to use the schedule. Comments from the focus group re- 
spondents indicate that over time, RVSRs develop individual “rules” for how to 
match the medical evidence to the rating schedule, many areas of which leave room 
for interpretation. This is likely one of the factors that allows them to process cases 
more quickly; they do not have to spend as much time deciding between evaluation 
levels. This is also a source of rating variance. 

VBA raters select the diagnostic code so the correctness of the rating decision de- 
pends on the level of knowledge and understanding each RVSR has about the med- 
ical descriptions in the rating schedule. The rating schedule contains over 700 diag- 
nostic codes representing distinct physical and mental impairments that are 
grouped by body systems or like symptoms. Although 700 diagnostic codes sounds 
like a large number, compared to the several thousands of codes contained in the 
International Classification of Diseases, Ninth Revision, Clinical Modification (ICD- 
9-CM), used by the medical profession, it can be assumed that the rating schedule 
is less detailed, and thus provides less information to guide evaluations. Increased 
detail in the rating schedule would likely reduce the amount of individual interpre- 
tation that currently results in inconsistencies in rating decisions. It would also re- 
quire extensive training to learn the revised schedule and additional job aids would 
need to be developed to improve use of the revised schedule. 
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These factors make matching the medical evidence to the criteria provided in the 
rating schedule a challenge. But an additional challenge is that the rating schedule 
does not have diagnostic codes for certain specific conditions, such as carpal tunnel 
syndrome, Parkinson’s disease, pacemakers, or pulmonary embolus. When a claim 
includes an unlisted condition, the RVSR rates it by analogy to a closely related dis- 
ease or injury. By their nature, these “analogous codes” lack criteria for rating, so 
raters have to research different body systems to make the evaluation and exercise 
a wide range of judgments to assign analogous codes. 

A final opinion raised during the site visits was that many appeals were the re- 
sult of rating decisions that did not include sufficient detail or explanation of why 
a claim was denied. As just described, much individual judgment is required in the 
rating process. This makes it even more important that all evidence be addressed 
in the rating decision. The reasons and bases section should include all subjective 
and objective evidence. It is important that veterans feel that their case has been 
clearly understood and evaluated. The letter should tell them what evidence was in 
their service records, what the VA medical examination provided (or why a VA ex- 
amination was not ordered), and all medical evidence that was submitted (e.g., pri- 
vate medical records). The letter has to establish the nexus between the medical evi- 
dence and the regulations that determined the outcome, describing how service con- 
nection was established, the regulations that applied to each issue, and what evi- 
dence is needed to establish service-connection or to receive a higher level of evalua- 
tion. 

Reducing Impediments 

The workload of RVSRs is not going to become lighter in the near future, so eas- 
ing the workload and reducing ambiguity could go a long way toward improving rat- 
ings. We propose some suggestions to help reduce existing impediments. 

First, newly hired RVSRs should work Pre-Development for several weeks to 
learn tbe system, why different types of evidence are needed, and how to determine 
that a case is ready to be rated. This would have at least two benefits. The trainee 
RVSR would not spend time working a case that has insufficient evidence and the 
mentoring RVSR would not have to do as much explanation about the types and 
need for different types of evidence. The obvious drawback to this is that it would 
take longer for new RVSRs to begin rating cases, but we believe having this addi- 
tional knowledge would pay off in the longer term. 

Second, the rating schedule is being updated, so it is probably not feasible to de- 
velop formal training for each new or revised diagnostic code. But it is important 
to address the problem caused by individual interpretation of diagnostic codes that 
are not detailed or specific results. A job aid that includes more specific information 
about the medical evidence would reduce the level of individual interpretation in 
ratings. In particular, a job aid that included specific codes and descriptions for dis- 
abilities that are relatively frequent and that currently fall under analogous codes, 
would do a great deal for improving accuracy in these ratings. It is much easier to 
identify the appropriate evaluation level when the criteria describe specific levels of 
disability (e.g., range of motion) rather than a more general description such as 
mild, moderate, and severe. This would allow the rater to match the code to the di- 
agnosis provided in the medical evidence, again reducing errors and variance in the 
award level. 

One of the commonly cited reasons for appeals is that the reasons and bases sec- 
tion of the decision does not provide sufficient information or an easily understand- 
able explanation that tells veterans why a claim was denied and what they must 
do to have the decision reconsidered. RVSRs use templates or scripts to outline the 
letter and ensure that required information for each section is included. Merely in- 
cluding all required information is not the same in terms of customer service or 
meeting the spirit of VCAA as is a well-written letter, and these templates cannot 
help with the complicated problem of presenting technical information in a manner 
that is well organized and that is easy for the veteran to understand. In this section 
of the letter, the RVSR describes the material evidence received and the level of evi- 
dence required to meet the legal standard as prescribed in the regulations. The abil- 
ity to understand, organize and clearly present all this information is difficult to 
train. One remedy is to provide multiple examples of well-written letters that 
RVSRs can use to guide their own efforts. A more structured approach would be to 
take the ability to synthesize information and present it in a well-structured, easily 
comprehensible document into consideration when hiring or promoting RVSRs. 

A final overall recommendation to reduce variance in ratings is to ensure that all 
RVSRs receive standardized training, both in content and delivery. Some refresher 
training is delivered via online tools, broadcasts, or in net meetings, which do pro- 
vide standardization. A good proportion of refresher training is determined by the 
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local office and is most often provided by Decision Review Officers. It is important 
that they receive comprehensive training in the technical area being addressed, but 
also understand how to deliver training; a train-the-trainer workshop that teaches 
basic training principles as well as how to work with adult learners should be re- 
quired. 

Summary 

It has been HumRRO’s pleasure to work with C&P Service for the past 7 years. 
We are honored to be even a small part of the valuable work the Veterans Benefits 
Administration does for America’s veterans. We have watched both the Skills Cer- 
tification program and C&P Services Training grow over this time. The resources 
and effort devoted to training have been reflected in steadily improving pass rates 
for the VSR Skills Certification test and in the very good pass rate for the RVSR 
end-of-training test. 

The greatest impediments to rating accuracy are the pressure to produce, the 
need for large amounts of medical knowledge and understanding, and ambiguity in 
interpreting the legal requirements. Being able to spend time in Pre-Development 
would increase a newly hired RVSR’s understanding of the overall claims process 
as well as the variety and depth of development that is required to rate a case. Job 
aids can neither reduce the ever increasing number of claims nor reduce their com- 
plexity, but by providing increased detail they can make the rating schedule easier 
to interpret and provide standardization that is currently lacking. Writing and ana- 
lytical ability were identified as key attributes of good RVSRs, but there is at 
present no systematic evaluation of these abilities when an individual is hired or 
promoted to the RVSR position. Finally, we provide a reminder of the importance 
of standardized training and delivery in ensuring that all rating specialists have a 
common understanding and method of working. 


Prepared Statement of Nicholas T. Bartzis, Cleveland, OH (Veteran) 

Good morning, my name is Nicholas T. Bartzis. I’m here today as a private cit- 
izen, concerned veteran, and employee of the Veterans Benefits Administration. I 
have served in the position of Rating Veterans Service Representative (RVSR) for 
approximately 8 years in the Cleveland VARO. My relevant past experience in- 
cluded being a training officer in the naval reserves. I possess a joint Law Degree 
and Master’s Degree in Public Administration. As an employee, I am frustrated that 
I am forced to choose between (1) doing the right thing for the veteran’s claim before 
me by ordering all of the needed intermediate work, or (2) meeting arbitrary produc- 
tion quotas imposed by my supervisors. 

First, I would like to thank each and every Member who voted for H.R. 5892. I 
believe that enactment of this bill into law could go far to correct many of the prob- 
lems we now face. Thank you! 

Rapid and accurate VA compensation is critical to the quick and efficient transi- 
tion of former servicemembers and spouses to civilian life. In my opinion, VA man- 
agers and adjudicators can do a better job adjudicating claims for VA disability ben- 
efits. In 2007, claims processing time increased to an average 183 days. It is my 
experience that most VA adjudicators endure a constant and mounting pressure to 
increase their processing of claims in spite of the fact that initial training and follow 
up training has not kept pace with the needs of VA adjudicators. In general, I and 
my coworkers do not feel that more decisions equal better individual decisions. 

The problems with the VA adjudication process identified by Congress, stake- 
holders and claimants seeking VA benefits are multi-factored and not exclusively 
the fault of the Veterans Benefits Administration (VBA) management. However, the 
problems created by the adjudication climate fostered by the VBA are the primary 
problem. These VBA issues are correctable, and they should be addressed imme- 
diately. 

In my testimony I will focus on the following four topics: 

• VBA training, both qualitative and quantitative issues. 

• Performance management, and a culture that emphasizes quantity of claims 
processed at the expense of the quality of the decisions made. 

• Accountability, who should be held accountable and why. 

• Potential solutions, from the perspective of one responsible for ratings claims. 
Training is Insufficient in Quantity and Quality 

I have been employed as an RVSR for 8 years. I was initially promised formal, 
centralized training. I have never completed this training because VA management 
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stressed production and did not give raters, such as myself, the time to complete 
this training. At each juncture, case production requirements for the station 
trumped my individual training needs. I want to stress that one reason cases are 
not consistently decided by the over 50 VA regional offices (ROs) is that, as I under- 
stand it (based on discussions with employees from other ROs and published stud- 
ies), training varies widely from RO to RO. Therefore, benefits may be awarded to 
some veterans but are denied to other veterans who are similarly situated. 

Nationwide, for the period of January 1, 2007 through September 5, 2008, the 
Training and Performance Support System (“TPSS”) Basic Rating Completion Re- 
port lists 2115 RVSR employees. Only 124 have completed the TPSS portion of the 
training. This is a completion rate of 17 percent. TPSS training is geared toward 
newly hired employees and is seldom completed as assigned. Instead, what I see is 
that, depending on the production demands of the station, those employees are 
quickly placed in a production capacity. Meaning they are assigned to quickly com- 
plete work for the station instead of undertaking further training under penalty of 
removal should they insist on spending time training instead of processing claims. 
These new employees are charged with making a correct and timely decision on the 
claim before them without first completing the proper training. 

For example, VARO Cleveland has approximately 70 RVSRs. However, in the pe- 
riod January 1, 2007 through September 5, 2008, the TPSS Basic Ratings Comple- 
tion Report listed 31 RVSRs scheduled to complete training. Of those 31 identified, 
none have completed the assigned training. This fact clearly shows a lack of com- 
mitment to training by local management. 

Poor initial training is only half of the problem. The job itself requires frequent 
and detailed updates and discussion about various changes in the law or court deci- 
sions. For example, the Veterans Claims Assistance Act of 2000 (VCAA) spawned 
numerous lawsuits and significantly changed the way VA operates. Also, upon 
issuance of a court decision or law change, VA must provide rapid instructions to 
its regional offices. Unfortunately, this is not the case. The U.S. Court of Appeals 
for Veterans Claims (CAVC) decision in Vazquez v. Peake , 05-0355, was decided in 
January 2008, but the VA did not provide instructions to its regional offices respect- 
ing this decision until June 2008. 

Performance Management is Primarily Geared Toward Quantity of Claims 
Processed and not Quality of Benefits Decisions 

Performance management may be defined as: “a system for relating the individual 
performance on the part of the employee, to the organizational objectives and per- 
formance of the agency.” For VA employees, their performance is controlled by two 
primary documents. First, is the employee appraisal system, and second, is the em- 
ployee’s performance plan. 

The Performance Appraisal Program lists the general criteria for how all Title 5 
employees will be evaluated. A subset of the Performance Appraisal Program is the 
individual’s performance plan. The individual’s performance plan describes the work 
expected from employees and measures that are expected of them. Presently for 
RVSRs, there are five stated performance measures: productivity, timeliness, cus- 
tomer service, quality of work, and organizational support. A supervisor assigns val- 
ues to each of these five stated performance measures. 

With the exception of productivity, I have seldom seen numerical values assigned 
to any of the other measures for RVSRs. As such, neither the employee nor any per- 
son who reviews their accomplishments after the fact has an accurate description 
of how much work the employee really did. In general, RVSRs do not obtain work 
credit for work such as: deferring the rating for additional development by other VA 
employees, instructional time for the VSR, or sufficient time for reviewing a claims 
file and ordering a VA exam or reordering the VA exam if it is insufficient. This 
fact is noted in recommendation number two of the Institute for Defense Analysis 
study entitled Analysis of Differences in Disability Compensation in the Department 
of Veterans Affairs. 

Good, knowledgeable RVSRs are, in a sense, punished when they do work that 
is not credited by VA management. For example, an RVSR does not get meaningful 
work credit for analyzing all the evidence in a case and ordering a VA examination, 
or for reviewing the file and determining that the present VA exam is inadequate, 
or for reviewing the file and correctly asking a medical question. Careful review of 
a VA claims file takes time. If, however, employees are not rewarded for careful 
work and are instead rewarded for processing large volumes of claims poorly, then 
inevitably claims will be improperly adjudicated and veterans will suffer. For exam- 
ple, if some VA employees are behind in their production, they may go through the 
file quickly (called top sheeting) and hope that somehow the claim is rated correctly 
or any error isn’t caught. Supervisors, who focus on production, have, in my experi- 
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ence, punished RVSRs who attempt to obtain additional needed development. This 
is one way in which quantity is emphasized to the detriment of quality. 

Recently our post determination team had a 68.4 percent FYTD production quan- 
tity failure rate for all journey level employees. This means that 68.4 percent of all 
the journey level — the most experienced employees in that team — have been unable 
to meet their cumulative production quotas for that year. When brought to their at- 
tention, local VA management was highly critical and dismissive of those who iden- 
tified this issue. Of course, while an individual employee may be unfairly punished 
by management, the real loser is the veteran whose claim is not adjudicated prop- 
erly. 

It is my understanding that VBA has not shared with representatives or employ- 
ees their method for determining how long each discrete step for evaluating a claim 
should take. 

More importantly, they have failed to quantify and provide fair work credit for 
accomplishing critical intermediate work prior to a claim being decided. Therefore 
what is needed is an accurate work credit system, within the performance plan, that 
addresses each discrete type of work and allows the employee sufficient time to ac- 
complish the work. Under the current system only one small portion of the work 
is measured, the final product, and that has not worked. 

Performance measures are intended to gauge the employee’s contribution to the 
agency’s mission. Instead, what I see is that the metrics as applied to the relevant 
VA employees do not adequately address the time it takes to really do the work 
properly. 

Accountability 

I believe that Congress wants to know why and who is accountable for our present 
dilemma of disparate decisions between states and untimely decisions on claims na- 
tionwide. As I indicated above, the problem has several causes. Many parties shoul- 
der the burden of our current dilemma. However, the primary burden for account- 
ability for the disparate decisions and long waiting times lies squarely with VBA. 

Should VBA undertake and scientifically measure the discrete steps it really takes 
to decide a claim correctly and seriously address the problem with concerned stake- 
holders, much would be done to alleviate the current problem. Instead, what I see 
is that the science not being applied and the results shared. Without the science, 
the number of employees needed to do the work is only an approximate guess based 
on historical precedent. Without the science, how long it takes to actually complete 
a typical claim and all its discrete steps is an approximate guess. 

I believe that most of the problems stem from one issue and one issue only: Sta- 
tion performance goals that are not established based on the time it takes to do the 
work. Instead what I see is that station performance goals are set by the VA Cen- 
tral office using historical and suspect data. A station’s Director and service center 
manager will sacrifice every activity that interferes with the employee deciding 
cases, including training, in order to make stations’ monthly performance goals. 

Potential Solutions 

I believe that Congress is well on the way to correcting many of the problems 
faced by veterans and the VBA employees who decide their claims. While the proc- 
ess takes time, unnecessary delays pose real hardships for veterans who are losing 
their houses or unable to feed themselves and their families while solutions are de- 
vised and adopted. With that in mind: 

1. I strongly encourage the passage of H.R. 5892. This wide-ranging bill is critical 
to addressing the root cause of the disparity in disability compensation. Specifi- 
cally, the study on employee work credit and the agency work management 
system. 

2. Increased oversight on VBA programs by Congress to insure compliance with 
the letter and spirit of programs by the VA managers assigned to accomplish 
the task. 

3. Immediate implementation of a mandatory interim training program for all 
employees. Within the next 12 months, each employee must complete all iden- 
tified but unaccomplished formal training per job category. 

4. Voluntary increased training by VBA to interested stakeholders like County 
Veteran Service Officers and service organizations. 

Thank you for your invitation to testify. I am available to answer any questions 
of the Committee. 
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Prepared Statement of Michael Walcoff, 

Deputy Under Secretary for Benefits, Veterans Benefits Administration, 
U.S. Department of Veterans Affairs 

Mr. Chairman and Members of the Committee: 

Thank you for the opportunity today to speak on the important topic of employee 
training within the Department of Veterans Affairs (VA), Veterans Benefits Admin- 
istration (VBA). I am pleased to be accompanied by Ms. Dorothy Mackay, VBA’s Di- 
rector of Employee Development and Training, and Mr. Brad Mayes, VBA’s Director 
of Compensation and Pension Service. 

Today, my testimony will focus on initial and on-going training for Compensation 
and Pension (C&P) employees. I also will describe employee performance standards, 
certification requirements, training oversight, and methods used to monitor and en- 
hance the quality and consistency of claims decisions. 

It is critical that our employees receive the essential guidance, materials, and 
tools to enable them to learn and develop the knowledge, skills, and abilities re- 
quired to be successful in their positions. To that end, VBA has deployed training 
tools and centralized training programs to provide a consistent approach to training. 

New Employee Training 

VBA has developed and implemented a standardized training curriculum for new 
claims processing employees, referred to as the Challenge Training Program. In fis- 
cal year 2006, VBA provided Challenge Training to 678 Veterans Service Represent- 
atives (VSRs) and Rating Veterans Service Representatives (RVSRs). That number 
more than doubled in fiscal year 2007 (VBA trained 1,447) and by the end of fiscal 
year 2008, VBA will have trained more than 2,150 new C&P employees. 

In the Challenge Training Program, new hires receive consistent instruction over 
the course of 2 years. Employees spend 3 weeks in centralized training, generally 
at the Veterans Benefits Academy in Baltimore, Maryland. The Academy can accom- 
modate up to 240 students at any one time. The centralized training brings together 
new hires from different regional offices and provides consistent training and net- 
working opportunities. The shared learning experience enables employees with di- 
verse backgrounds who work in different regional offices across the country to de- 
velop a shared sense of mission. 

Instruction at the Academy is provided by experienced VBA staff who are subject 
matter experts and, who have completed an instructor development course. At the 
end of each daily session, trainees are invited to complete an anonymous question- 
naire to describe what value they gained from the lessons and to evaluate the in- 
structional methods. This information is used to continually adjust and improve the 
quality of training sessions. 

When employees return to their home stations, they continue to learn through ad- 
ditional on-the-job training. When classroom instruction is used to develop knowl- 
edge on a particular topic, it is generally followed by work on cases involving that 
topic. As the new hires begin working on actual cases, they spend part of their day 
developing skills through interactive use of the computer-based Training and Per- 
formance Support System (TPSS). This system provides topic modules with a mixed 
media approach to learning that includes case studies and performance-based test- 
ing. It can be utilized by an individual or accessed by a group of individuals to pro- 
mote discussion of a topic. Currently there are 11 TPSS modules for VSRs, and 13 
TPSS modules for RVSRs. 

VBA is continually striving to enhance the quality of the Challenge Training Pro- 
gram. An independent contractor, hired to evaluate the program, surveyed 1,405 
employees and 183 key personnel. We are assessing the results from that evaluation 
and will use the information to improve the Challenge Training Program. 

Annual 80-Hour Training Requirement 

All VSRs and RVSRs are required to complete 80 hours of training each year, al- 
though new employees will complete more than this during their first year. Admiral 
Cooper, the former Under Secretary for Benefits, introduced this requirement. Its 
continuation is supported by Admiral Dunne, the current Acting Under Secretary 
for Benefits, and the rest of VBA leadership. The training has been mandated to 
ensure that claims processing personnel are provided with the most current C&P 
policies and procedures, as well as the latest decisions from the Court of Appeals 
for Veterans Claims and precedent-setting opinions from the VA General Counsel. 
This training also provides for refresher courses in complex claims issues that are 
not seen on a regular basis, such as special monthly compensation rating codes and 
benefits available for permanently and totally disabled veterans. 
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Each regional office develops a general training plan for its employees at the be- 
ginning of the fiscal year. At least 60 of the required 80 training hours need to come 
from a list of core technical training topics identified by the C&P Service. For the 
remaining 20 hours, regional offices are given flexibility to establish training topics 
based on local needs. This allows regional offices to focus on emerging issues or 
claims processing areas where errors have been noted. Regional offices are also 
given flexibility in choosing the instructional method used to deliver the total 80 
hours of required training. These methods may include classroom training using ap- 
proved lesson plans or use of the computer-based TPSS training modules. In addi- 
tion, regional offices can take advantage of nationwide training programs offered on 
important and timely topics. Over the past year, this training included topics such 
as researching stressors in claims for PTSD, C&P medical examinations in claims 
for PTSD and traumatic brain injury, and attorney representation of veterans in ap- 
pealed claims. 

Employee Performance Standards and Accountability 

Another VBA organizational cornerstone initiative to improve the delivery of ben- 
efits and enhance accountability is our system of individual performance assess- 
ment. All VSRs and RVSRs are subject to national performance standards meas- 
uring the critical elements of quality, productivity, customer service, and workload 
management, as well as a non-critical element related to organizational support/ 
teamwork. Performance standards are commensurate with an employee’s experience 
level in the position. These standards are reviewed periodically and amended as nec- 
essary in response to changes in workload and claims processing procedures. Man- 
agers use an automated tool, called ASPEN (Access Standardized Performance Ele- 
ments nationwide), to track work items completed and to measure VSR and RVSR 
performance. Local accuracy reviews are conducted for all decision-makers using the 
national quality criteria for the Systematic Technical Accuracy Review (STAR) pro- 
gram. 

Under VBA’s performance appraisal program, employee performance is evaluated 
annually and linked to the employee’s performance standards. An employee’s level 
of achievement in each of the four critical elements and one non-critical element is 
evaluated by a supervisor as exceptional, fully successful, or less than fully success- 
ful. Based on evaluations in each of the five areas, a combined overall performance 
rating is given. The overall ratings include outstanding, excellent, fully successful, 
minimally successful, and unsatisfactory. 

In the event an employee’s performance is not meeting the fully successful level 
of achievement for a critical element, an employee will be placed on a performance 
improvement plan (PIP). The PIP identifies the employee’s specific performance defi- 
ciencies, the successful level of performance, the action(s) that must be taken by the 
employee to improve to the successful level of performance, the methods that will 
be employed to measure the improvement, and provisions for counseling, additional 
and focused individualized training, or other appropriate assistance. If the employ- 
ee’s performance does not rise to at least the fully successful level for his/her critical 
element(s), the employee will be removed from the position. 

In conjunction with the national performance standards, VBA has developed a 
certification process to assess job proficiency. After successfully demonstrating job 
proficiency through the certification process, an employee is promoted to the journey 
level, thereby linking job proficiency to pay grade. 

Since 2002, the full performance level for a VSR has been the GS-11 level. Pro- 
motion to the GS-11 level is contingent upon successful completion of certification 
testing. Through successfully passing the certification test, VSRs demonstrate that 
they have the skills necessary to perform the full range of VSR duties, including 
the ability to work independently on the most complex cases and to review and ap- 
prove the work of others. Through the national certification program, VBA is raising 
the skill levels of our core decision-makers and producing greater consistency in 
claims decisions. 

Training Oversight 

Along with an expanded training agenda to accommodate the hiring initiative, 
VBA has enhanced its training oversight methods to improve accountability. Man- 
agers at all levels are held responsible for ensuring that training goals are set and 
training requirements are met. Each regional office is accountable for submitting a 
training plan at the beginning of the fiscal year and following through on the plan. 
The plan is based on an assessment of local needs and anticipates the content and 
timing of training to fulfill the annual training requirements for regional office em- 
ployees. In addition, VBA recently created the staff position of Training Manager 
for each regional office. The Training Manager is responsible for local training re- 



70 


views, as well as analyzing performance indicators to determine local training needs 
and implementing the training necessary to meet those needs. 

The Training Manager is also the lead administrator for the Learning Manage- 
ment System (LMS). LMS is a computerized learning system that was implemented 
in 2008 that is designed to present training sessions to individual employees and 
maintain a record of each completed session. Hyperlinks are available through LMS 
to access training course materials and curricula from the C&P Intranet training 
Web site, as well as from TPSS training modules. LMS tracks learning hours 
planned and completed, and is easily accessible by employees and management. 

On the national level, VBA has established an Employee Training and Learning 
Board to establish training priorities, promote accountability, and help ensure that 
training decisions are coordinated and consistent with long range policy plans. The 
Board is chaired by one of VBA’s area Directors, and members include regional and 
central office Directors. 

Quality and Consistency 

As part of the continued commitment to quality improvement, VBA is expanding 
its quality assurance program. As part of the expansion, the National Systematic 
Technical Accuracy Review (STAR) staff was consolidated to Nashville, TN, and ten 
additional staff members were hired. 

The quality assurance program expansion supports an increase in the annual case 
sample size for national accuracy reviews from 120 cases per regional office to 246 
cases per regional office. This represents a more statistically sound sample size to 
measure regional office accuracy levels. 

In addition, the Quality Assurance Staff conducted several focused case reviews 
this year. These included a special quality review of radiation cases, an ongoing re- 
view of extraordinarily large benefit awards, and a special review of cases completed 
by the Appeals Management Center. 

The Quality Assurance Staff is also responsible for conducting on-going quarterly 
data analysis to identify the most frequently rated disabilities or diagnostic codes; 
assessing the frequency of the assignment or denial of service-connection for each 
code by regional office; and assessing the most frequently assigned evaluation mode 
for each code by regional office. Focused audit-style case reviews are conducted at 
regional offices where rating results are found to be significantly outside the estab- 
lished national averages in order to identify causes of inconsistency. Through these 
regular reviews, VBA expects to gain more consistent decision-making across re- 
gional offices, as well as a better understanding of underlying causes for variation 
across geographic boundaries. 

These quality assurance programs are used to identify where additional guidance 
and training are needed to improve accuracy and consistency nationwide, as well 
as to drive VBA procedural and regulatory changes. 

Mr. Chairman, this concludes my testimony. I will be happy to respond to any 
questions that you or other Members of the Committee may have. 
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MATERIAL SUBMITTED FOR THE RECORD 

U.S. Government Accountability Office 
Report to the Chairman, Committee on Veterans’ Affairs, 
House of Representatives 

VETERANS’ BENEFITS: Increased Focus on Evaluation and 
Accountability Would Enhance Training and 
Performance Management for Claims Processors 

May 2008 

Report No. GAO-08-561 
GAO Highlights 


Why GAO Did This Study 

Faced with an increase in disability claims, the Veterans Benefits Administration 
(VBA) is hiring a large number of new claims processing staff. We were asked to 
determine: (1) What training is provided to new and experienced claims processors 
and how uniform is this training? (2) To what extent has VBA planned this training 
strategically, and how well is the training designed, implemented, and evaluated? 
and (3) To what extent is the performance management system for claims processors 
consistent with generally accepted practices? To answer the questions, GAO re- 
viewed documents including VBA policies and training curricula; interviewed VBA 
central office officials; visited 4 of VBA’s 57 regional offices, which were selected to 
achieve diversity in geographic location, number of staff, and officewide accuracy in 
claims processing; and compared VBA’s training and performance management to 
generally accepted practices identified by GAO. 

What GAO Recommends 

GAO is recommending that VBA collect feedback on training provided by regional 
offices and use this feedback to further improve training, and hold staff accountable 
for meeting their training requirement. GAO also recommends that the VA assess 
and, if necessary, adjust its process for placing staff in overall performance cat- 
egories. In its comments, VA agreed with GAO’s conclusions and concurred with the 
recommendations. 

What GAO Found 

VBA has a standardized training curriculum for new staff and a training require- 
ment for all staff, but does not hold staff accountable for meeting this requirement. 
The curriculum for new staff includes what is referred to as centralized training and 
training at their home offices. All claims processors must complete 80 hours of train- 
ing annually, which may cover a mix of topics identified centrally and by regional 
offices. Individual staff members face no consequences for failing to meet the train- 
ing requirement, however, and VBA has not tracked training completion by individ- 
uals. It is implementing a new system that should provide this capacity. 

Although VBA has taken steps to plan its training strategically, the agency does 
not adequately evaluate training and may be falling short in training design and 
implementation. VBA has a training board that assesses its overall training needs. 
However, the agency does not consistently collect feedback on regional office train- 
ing, and both new and experienced staff GAO interviewed raised issues with their 
training. Some new staff raised concerns about the consistency of training provided 
by different instructors and about the usefulness of an online learning tool. Some 
experienced staff believe that 80 hours of training annually is not necessary, some 
training was not relevant for them, and workload pressures impede training. 

The performance management system for claims processors generally conforms to 
GAO-identified key practices, but the formula for assigning overall ratings may pre- 
vent managers from fully acknowledging and rewarding staff for higher levels of 
performance. The system aligns individual and organizational performance meas- 
ures and requires that staff be given feedback throughout the year. However, VBA 
officials raised concerns about the formula used to assign overall ratings. Almost all 
staff in the offices GAO visited were placed in only two of five overall rating cat- 
egories, although managers said greater differentiation would more accurately re- 
flect actual performance differences. The Department of Veterans Affairs (VA) has 
not examined the ratings distribution, but acknowledges a potential issue with its 
formula and is considering changes. 
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Fiscal Year 2007 Appraisals for Four Offices 
Were Concentrated in Two Categories 
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Source: VBA regional offices. 
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U.S. Government Accountability Office 
Washington, DC 
May 27, 2008 

Hon. Bob Filner 
Chairman 

Committee on Veterans’ Affairs 
House of Representatives 

Dear Mr. Chairman: 

The Veterans Benefits Administration (VBA) is facing an increased volume of 
claims for disability benefits related to the current conflicts in Afghanistan and Iraq 
as well as the aging of veterans from past conflicts. Between fiscal years 2000 and 
2006, the number of disability-related claims filed annually with VBA increased by 
almost 40 percent. As a result, VBA continues to experience challenges in processing 
veterans’ disability claims. As of fiscal year 2007, VBA had approximately 392,000 
disability claims pending benefit decisions, and the average time these claims were 
pending was 132 days. According to VBA, the current conflicts have also produced 
more claims related to post-traumatic stress disorder and traumatic brain injury, 
conditions few VBA staff have had much experience evaluating. To process the in- 
creased volume of claims, in fiscal year 2007 the agency began hiring a large num- 
ber of new Veterans Service Representatives (VSR), who collect evidence related to 
veterans’ claims, and Rating Veterans Service Representatives (RVSR), who evalu- 
ate claims and determine benefit eligibility. It plans to add 3,100 new claims-proc- 
essing staff by the end of fiscal year 2008. 

Given the increased volume of claims, the increased focus on certain types of dis- 
abilities, and the large number of new hires, training and performance management 
systems for VSRs and RVSRs now play an especially critical role in enabling VBA 
to meet its organizational claims processing goals for accuracy and productivity. 
Training that is properly designed and implemented is vital both to help new staff 
learn their jobs and experienced staff to update their knowledge and learn about 
emerging issues. An effective performance management system would also help 
VBA manage its staff on a day-to-day basis to achieve its organizational goals. To 
provide Congress with information on the training and performance management of 
claims processors, we were asked to determine: (1) What training is provided to new 
and experienced claims processors and how uniform is this training? (2) To what 
extent has VBA developed a strategic approach to planning training for claims proc- 
essors and how well is their training designed, implemented, and evaluated? And 
(3) To what extent is the performance management system for claims processors 
consistent with generally accepted performance management practices in the public 
sector? 
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To address these objectives, we collected documents and data from VBA central 
office and interviewed central office staff. In addition, GAO experts on training re- 
viewed VBA documents related to training curriculum, lesson plans, and course 
evaluations. We conducted site visits to 4 of VBA’s 57 regional offices — Atlanta, Bal- 
timore, Milwaukee, and Portland, Oregon. These offices were selected to achieve di- 
versity in geographical location, number of staff, and officewide accuracy in claims 
processing. While we examined VBA-wide policies and requirements, we primarily 
assessed how the training and performance management systems are implemented 
at four sites. Therefore, our results may not be representative of how these systems 
are implemented across all regional offices. We assessed VBA’s training and per- 
formance management practices by comparing them to certain generally accepted 
practices for Federal agencies in these areas that have been identified by GAO. 1 We 
conducted this performance audit from September 2007 through May 2008 in ac- 
cordance with generally accepted Government auditing standards. Those standards 
require that we plan and perform the audit to obtain sufficient, appropriate evi- 
dence to provide a reasonable basis for our findings and conclusions based on our 
audit objectives. We believe that the evidence obtained provides a reasonable basis 
for our findings and conclusions based on our audit objectives. (See app. I for more 
detailed information on our objectives, scope, and methodology.) 

Results in Brief 

VBA has a standard training curriculum for new claims processors and an 80- 
hour annual training requirement for all claims processors, but staff are not held 
accountable for meeting this requirement. VBA’s three-stage training program for 
new staff is intended to deliver training in a consistent manner. First, VBA policy 
states that new staff are required to complete some orientation training, which is 
provided in their home offices. Second, they are required to attend a 3-week stand- 
ardized training session, referred to as centralized training, that provides a basic 
introduction to their job responsibilities. Third, new staff are required to spend sev- 
eral more months in training at their home offices, which is supposed to include on- 
the-job training, instructor-led training classes that follow a required curriculum, 
and use of an online learning tool called the Training and Performance Support Sys- 
tem. VBA policy states that all claims processors are required to complete a min- 
imum of 80 hours of training annually, and regional offices have some discretion 
over what training they provide to meet this requirement. At least 60 hours must 
be selected from a list of core topics identified by VBA central office. Regional offices 
may choose the topics for the remaining 20 hours based on local needs, such as to 
prevent errors identified in processing claims. Each regional office develops an an- 
nual training plan listing the courses needed, and VBA central office periodically 
reviews these plans and provides feedback to regional offices. Although VBA has a 
training requirement for VSRs and RVSRs, it does not have a policy outlining con- 
sequences for individual staff who do not complete their required training. Further, 
VBA does not maintain data on the training completed by individuals, but agency 
officials said they are currently implementing a new, online learning management 
system that should enable them to do so in the future. 

VBA is taking steps to strategically plan its training, but does not adequately 
evaluate its training and may be falling short in some areas of training design and 
implementation. VBA appears to have followed several accepted practices in plan- 
ning its training, including the establishment of a training board that assesses 
VBAs overall training needs and makes recommendations to the Undersecretary for 
Benefits. Also, VBA makes some effort to evaluate its centralized training for new 
staff, soliciting feedback from students with forms that are well-constructed and 
well-balanced. However, VBA does not require regional offices to collect feedback on 
any of the training they provide to new and experienced staff. In fact, claims proc- 
essors we interviewed raised some issues with the training they received. For exam- 
ple, some new staff reported that different instructors in centralized training ses- 
sions sometimes taught different ways of performing the same procedure, and that 
one of VBA’s online learning tools — the Training and Performance Support Sys- 
tem — is too theoretical and often out-of-date. More experienced staff had mixed opin- 
ions as to whether 80 hours of training annually is appropriate for all staff. Also, 
many experienced staff indicated that training topics are redundant from year to 
year, and some told us that courses available to them are not always relevant for 


1 These practices are laid out primarily in two GAO reports: Human Capital: A Guide for As- 
sessing Strategic Training and Development Efforts in the Federal Government, GAO-04-546G 
(Washington, DC: March 2004) and Results Oriented Cultures: Creating a Clear Linkage be- 
tween Individual Performance and Organizational Success, GAO— 03-488 (Washington, DC: Mar. 
14, 2003). 
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their position or experience level because they are often adapted from courses for 
new staff. Some staff said they struggle to meet the annual 80-hour training re- 
quirement because of workload pressures. 

The Department of Veterans Affairs’ performance management system for VSRs 
and RVSRs generally conforms to accepted practices, including aligning individual 
and organizational performance measures, but the system may not clearly differen- 
tiate among staffs overall performance levels. Several elements of VSRs’ and 
RVSRs’ performance are evaluated, and these elements are generally aligned with 
VBA’s organizational performance measures. For example, VSRs and RVSRs are 
evaluated on their accuracy in claims processing, and one of VBA’s organizational 
performance measures is accuracy in claims processing. VBA’s performance manage- 
ment system is also consistent with other accepted practices, such as providing per- 
formance feedback throughout the year and emphasizing collaboration. However, 
the system may not clearly and accurately differentiate among the overall perform- 
ance levels of VSRs and RVSRs. A VA-wide formula is used to translate an employ- 
ee’s ratings on all individual elements into one of five overall rating categories. Sev- 
eral VBA central and regional office managers raised concerns with this formula, 
saying that it is difficult for staff to be placed in certain overall performance cat- 
egories, even if staffs performance truly does fall within one of those categories. In 
fact, when we reviewed the results of VSR and RVSR appraisals at the regional of- 
fices we visited, almost all staff were placed in either the outstanding (highest) or 
fully successful (middle) categories. To the extent that the performance appraisals 
do not make meaningful distinctions in performance, staff may lack the constructive 
feedback they need to improve, and managers may lack the information they need 
to reward top performers and address performance issues. Although VA acknowl- 
edged this issue and indicated that it is considering changes to the system, no for- 
mal actions have been taken to date. 

We are recommending that VBA central office collect feedback on training pro- 
vided by the regional offices, to determine whether (1) 80 hours is the appropriate 
amount of annual training for all staff, (2) regional offices are providing training 
that is relevant for all staff, and (3) whether any changes are needed to improve 
the Training and Performance Support System. We are also recommending that 
VBA central office hold individual staff accountable for meeting their training re- 
quirement and that VA assess and, if necessary, adjust its performance rating sys- 
tem for staff to make it a more meaningful management tool. In its comments, VA 
agreed with our conclusions and concurred with our recommendations. 

Background 

In fiscal year 2007, the Department of Veterans Affairs (VA) paid about $37V2 bil- 
lion in disability compensation and pension benefits to more than 3.6 million vet- 
erans and their families. Through its disability compensation program, the VBA 
pays monthly benefits to veterans with service-connected disabilities (injuries or dis- 
eases incurred or aggravated while on active military duty). Monthly benefit 
amounts vary according to the severity of the disability. Through its pension benefit 
program, VBA pays monthly benefits to wartime veterans with low incomes who are 
either elderly or permanently and totally disabled for reasons not service-connected. 
In addition, VBA pays dependency and indemnity compensation to some deceased 
veterans’ spouses, children, and parents and to survivors of servicemembers who 
died while on active duty. 

When a veteran submits a benefits claim to any of VBA’s 57 regional offices, a 
Veterans Service Representative (VSR) is responsible for obtaining the relevant evi- 
dence to evaluate the claim. For disability compensation benefits, such evidence in- 
cludes veterans’ military service records, medical examinations, and treatment 
records from VA medical facilities and private providers. Once a claim is developed 
(i.e., has all the necessary evidence), a Rating Veterans Service Representative 
(RVSR) evaluates the claim, determines whether the claimant is eligible for bene- 
fits, and assigns a disability rating based on degree of impairment. The rating deter- 
mines the amount of benefits the veteran will receive. For the pension program, 
claims processing staff review the veteran’s military, financial, and other records to 
determine eligibility. Eligible veterans receive monthly pension benefit payments 
based on the difference between their countable income, as determined by VA, and 
the maximum pension amounts as updated annually by statute. 2 In fiscal year 2007, 
VBA employed over 4,100 VSRs and about 1,800 RVSRs to administer the disability 
compensation and pension programs’ caseload of almost 3.8 million claims. 

In 2001 the VA Claims Processing Task Force noted that VSRs were responsible 
for understanding almost 11,000 separate benefit delivery tasks, such as tasks in 


2 38 U.S.C. § 5312(a). 
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claims establishment, claims development, public contacts, and appeals. To improve 
VBA’s workload controls, accuracy rates, and timeliness, the Task Force rec- 
ommended that VA divide these tasks among a number of claims processing teams 
with defined functions. To that end, in fiscal year 2002, VBA developed the Claims 
Processing Improvement model that created six claims processing teams, based on 
phases of the claims process. (See table 1.) 


Table 1 — VBA’s Disability Compensation and Pension Service’s Claims 

Processing Teams 


Team 

Summary of claims processing duties 

Triage Team 

Establishes the regional office’s tracking procedures for all 
mail as well as processes claims that only require a brief 
review to determine eligibility. 

Pre-Determination Team 

Develops evidence for disability ratings and prepares ad- 
ministrative decisions. 

Rating Team 

Makes decisions on claims that require consideration of 
medical evidence. 

Post-Determination Team 

Develops evidence for non-rating issues, processes benefit 
awards, and notifies veterans of rating decisions. 

Public Contact Team 

Conducts personal interviews and handles telephone in- 
quiries, including calls from veterans. 

Appeals Team 

Handles requests for reconsideration of claims where vet- 
erans have formally disagreed with claim decisions. 


Source: VBA. 

Note: The Rating Team is made up of RVSRs, the Post-Determination and Public Contact 
teams are made up of VSRs, and the Pre-Determination, Triage, and Appeals teams are 
made up of both RVSRs and VSRs. 

According to one VA official, new claims processing staff generally begin as VSRs 
and typically have a probationary period of about 1 year. 3 After their probationary 
period ends, staff can either continue to qualify to become senior VSRs or apply for 
RVSR positions. 4 VSRs are also given the option to rotate to other VSR claim teams 
to gain a broader understanding of the claims process. 

VBA Has a Uniform Training Curriculum for New Claims Processors and 
an Annual Training Requirement for All Claims Processors, but Staff 
Are Not Held Accountable for Meeting This Requirement 

VBA has established a standardized curriculum for training new VSRs and 
RVSRs on how to process claims, and it has an 80-hour annual training requirement 
for both new and experienced staff; however, it does not hold individual staff ac- 
countable for meeting this requirement. VBA has designed a uniform curriculum for 
training new VSRs and RVSRs that is implemented in three phases — initial orienta- 
tion training, a 3-week training session referred to as centralized training, and com- 
prehensive on-the-job and classroom training after centralizing training. It also re- 
quires all staff to meet an annual 80-hour training requirement. To ensure that 
staff meet this requirement, each regional office must develop an annual training 
plan, which can contain a mix of training topics identified by VBA central office and 
by the regional office. However, individual staff members are not held accountable 
for meeting their training requirement. 

Training for New Staff Is Conducted in Three Stages Using a Uniform Cur- 
riculum 

VBA has a highly structured, three-phased program for all new claims processors 
designed to deliver standardized training, regardless of training location or indi- 
vidual instructors. (See fig. 1.) For example, each topic included in this training pro- 
gram contains a detailed lesson plan with review exercises, student handouts, and 
copies of slides used during the instructor’s presentation. Each phase in this pro- 


3 While new claims processors are on probation, 100 percent of the claims work they perform 
is quality reviewed by a supervisor. After their probationary period, only a small sample of their 
claims are quality reviewed. 

4 Typically, RVSRs are promoted VSRs, although in some instances, VA hires RVSRs from out- 
side of VA who have medical or legal experience. 
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gram is designed to both introduce new material and reinforce material from the 
previous phase, according to a VBA official. 

Figure 1 — Phases of Training for New VSRs and RVSRs 
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Source: GAO analysis. 

According to VBA policy, the first phase of training for new VSRs and RVSRs is 
prerequisite training. New VSRs and RVSRs begin prerequisite training at their 
home regional office as soon as they begin working. Prerequisite training lays the 
foundation for future training by introducing new VSRs to topics such as the soft- 
ware applications used to process and track claims, medical terminology, the system 
for maintaining and filing a case folder, and the process for requesting medical 
records. Although VBA specifies the topics that must be covered during prerequisite 
training, regional offices can choose the format for the training and the timeframe. 
New VSRs and RVSRs typically spend 2 to 3 weeks completing prerequisite training 
in their home office before they begin the second program phase, centralized train- 
ing. 

During what is referred to as centralized training, new VSRs and RVSRs spend 
3 weeks in intensive classroom training. Participants from multiple regional offices 
are typically brought together in centralized training sessions, which may occur at 
their home regional office, another regional office, or the Veterans Benefits Academy 
in Baltimore, Maryland. According to VBA officials in three of the four offices we 
visited, bringing together VSRs and RVSRs from different regional offices helps to 
promote networking opportunities, while VBA officials from two of these offices also 
stated that it provides a nationwide perspective on VBA. Centralized training pro- 
vides an overview of the technical aspects of the VSR and RVSR positions. Training 
instructors should follow the prescribed schedule and curriculum dictating when 
and how material is taught. For example, for a particular topic, the instructor’s 
guide explains the length of the lesson, the instructional method, and the materials 
required; lays out the information that must be covered; and provides exercises to 
review the material. (See fig. 2 for a sample of an instructor’s guide from the cen- 
tralized training curriculum.) Centralized training classes have at least three in- 
structors, but the actual number can vary depending on the size of the group. VBA’s 
goal is to maintain a minimum ratio of instructors to students. 









77 


Figure 2 — Phases of Training for New VSRs and RVSRs 
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Source: VBA. 

The first week of centralized training for VSRs focuses on key concepts, such as 
security, privacy and records management; terminology; and job tools, such as the 
policy manual and software applications. The final 2 weeks of training focus on the 
different roles and responsibilities of VSRs on the Pre-determination and Post-deter- 
mination teams in processing claims. To practice processing different types of claims 
and processing claims from start to finish, VSRs work on either real claims or hypo- 
thetical claims specifically designed for training. Centralized training for new 
RVSRs — many of whom have been promoted from the VSR position — focuses on top- 
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ics such as systems of the human body, how to review medical records, and how 
to interpret a medical exam. According to staff in one site we visited, RVSRs new 
to VBA also take VSR centralized training or its equivalent to learn the overall pro- 
cedures for processing claims. 

To accommodate the influx of new staff it must train, in fiscal year 2007 VBA 
substantially increased the frequency of centralized training and is increasing stu- 
dent capacity at the Veterans Benefits Academy. During fiscal year 2007, VBA held 
67 centralized training sessions for 1,458 new VSRs and RVSRs. Centralized train- 
ing sessions were conducted at 26 different regional offices during fiscal year 2007, 
in addition to the Veterans Benefits Academy. By comparison, during fiscal year 
2006, VBA held 27 centralized training sessions for 678 new claims processors. 

To implement centralized training, VBA relies on qualified regional office staff 
who have received training on how to be an instructor. According to VBA officials, 
centralized training instructors may be Senior VSRs, RVSRs, supervisors, or other 
staff identified by regional office managers as having the capability and the right 
personality to be effective instructors. Potential instructors have certain training re- 
quirements. First, they must complete the week-long Instructor Development 
Course, which covers the ways different adults learn, the process for developing les- 
son plans, and the use of different training methods and media. During this course, 
participants are videotaped and given feedback on their presentation style. In addi- 
tion, each time instructors teach a centralized training session, they are supposed 
to take the 2V2 day Challenge Curriculum Course, designed to update instructors 
on changes to the curriculum and general training issues. Between October 2006 
and February 2008, about 250 VSRs and RVSRs from regional offices completed the 
Instructor Development Course, and VBA officials reported that, given the influx of 
new VSRs and RVSRs, they are increasing the number of times this course is of- 
fered in order to train more instructors. Instructors can teach centralized training 
sessions in their home office, another regional office, or the Veterans Benefits Acad- 
emy. 5 

When new VSRs and RVSRs return to their home office after centralized training, 
they are required to begin their third phase of training, which is supposed to include 
on-the-job, classroom, and computer-based training, all conducted by and at their re- 
gional office. In the regional offices we visited, managers indicated that new VSRs 
and RVSRs typically take about 6 to 12 months after they return from centralized 
training to complete all the training requirements for new staff. During this final 
phase, new claims processing staff cover more advanced topics, building on what 
they learned in centralized training. Under the supervision of experienced claims 
processors, they work on increasingly complex types of real claims. On-the-job train- 
ing is supplemented in the offices we visited by regular classroom training that fol- 
lows a required curriculum of courses developed by VBA’s Compensation and Pen- 
sion Service, specifically for new VSRs and RVSRs. For example, new VSRs might 
complete a class in processing burial claims and then spend time actually processing 
such claims. The amount of time spent working on each type of claim varies from 
a couple of days to a few weeks, depending on the complexity of the claim. On-the- 
job training is also supposed to be supplemented with modules from the Training 
and Performance Support System (TPSS), an interactive online system that can be 
used by staff individually or in a group. 6 TPSS modules provide detailed lessons, 
practice cases, and tests for VSRs and RVSRs. Modules for new VSRs cover topics 
such as burial benefits and medical terminology; RVSR modules cover topics such 
as the musculoskeletal system, general medical terminology, and introduction to 
post-traumatic stress disorder. 

New and Experienced Staff Have an Annual Training Requirement, and Re- 
gional Offices Develop Training Plans That Cover a Mix of Topics Iden- 
tified Centrally and Locally 

A policy established by VBA’s Compensation and Pension Service requires both 
new and experienced VSRs and RVSRs to complete a minimum of 80 hours of tech- 
nical training annually, double the number VBA requires of its employees in other 
technical positions. 7 VBA officials said this higher training requirement for VSRs 


5 Staff who teach classes other than centralized training are not required to take the week- 
long Instructor Development Course, although they may do so if openings exist. They can also 
take an 8-hour condensed course for regional instructors. 

6 In 2001, we reported that VBA had spent or obligated about $18.6 million of the estimated 
total TPSS program cost of $32 million. See GAO, Veterans’ Benefits: Training for Claims Proc- 
essors Needs Evaluation , GAO-01-601 (Washington, DC: May 31, 2001). 

7 VBA defines an experienced VSR or RVSR as one who has been in that position for 1 year 
or more. 
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and RVSRs is justified because their jobs are particularly complex and they must 
work with constantly changing policies and procedures. 

The 80-hour training requirement has two parts. At least 60 hours must come 
from a list of core technical training topics identified by the central office of the 
Compensation and Pension Service. For example, core topics for VSRs in fiscal year 
2007 included establishing veteran status and asbestos claims development; topics 
for RVSRs included due process provisions and eye-vision issues. VBA specifies more 
core topics than are necessary to meet the 60-hour requirement, so regional offices 
can choose those topics most relevant to their needs. They can also choose the train- 
ing method used to address each topic, such as classroom or TPSS training. (See 
app. II for the list of core technical training topics for fiscal year 2007.) Regional 
offices determine the training topics that are used to meet the remaining 20 hours, 
based on local needs and input. Regional offices may select topics from the list of 
core technical training topics or identify other topics on their own. 

The four regional offices we visited varied in the extent to which they utilized 
their discretion to choose topics outside the core technical training topics in fiscal 
year 2007. Two sites selected the required 60 hours of training from the core re- 
quirements and identified their own topics for the remaining 20 hours. In the other 
two sites, almost all the training provided to staff in fiscal year 2007 was based on 
topics from the list of core requirements. An official in one regional office, for exam- 
ple, said that his office used its full 20 hours to provide training on new and emerg- 
ing issues that are not covered by the core technical training topics, as well as train- 
ing to address error prone areas. An official in another regional office said the core 
requirements satisfied staff training needs in fiscal year 2007, possibly because this 
regional office had a large proportion of new staff and the core topics are focused 
on the needs of new staff. 

Regional offices must develop training plans each year that indicate which courses 
will actually be provided to staff to enable them to meet the 80-hour training re- 
quirement. The training plan is a list of courses that the regional office plans to 
offer throughout the year, as well as the expected length and number and types of 
participants in each course. In the regional offices we visited, when managers de- 
velop their training plans, they solicit input from supervisors of VSRs and RVSRs 
and typically also consider national or local error trend data. Regional offices must 
submit their plans to the VBA central office at the beginning of each fiscal year for 
review and feedback. Central office officials review the plans to determine whether 
(1) the regional office will deliver at least 60 hours of training on the required core 
topics, (2) the additional topics identified by the regional office are appropriate, and 
(3) staff in similar positions within an office receive the same level and type of train- 
ing. According to central office officials, they provide feedback to the regional offices 
on their current plans as well as guidance on what topics to include in the next 
year’s training plans. Regional offices can adjust their training plans throughout the 
year to address shifting priorities and unexpected training needs. For example, a 
regional office may add or remove courses from the plan in response to changing 
trends in errors or policy changes resulting from legal decisions. (See app. Ill for 
excerpts from the fiscal year 2007 training plans from the regional offices we vis- 
ited.) 

While regional offices have discretion over the methods they use to provide train- 
ing, the four offices we visited relied primarily on classroom training in fiscal year 
2007. In each of these offices, at least 80 percent of the total fiscal year 2007 train- 
ing hours completed by all claims processors was in the form of classroom instruc- 
tion (see fig. 3). Officials in two of the regional offices we visited said they used les- 
son plans provided by the Compensation and Pension Service and adapted these 
plans to the needs of their staff; one regional office developed its own courses. An 
official in one office said they sometimes invite guest speakers, and an official in 
another regional office said that classroom training is sometimes delivered as part 
of team meetings. The offices we visited generally made little use of other training 
methods. Only one office used TPSS for its training more than 1 percent of the time. 
Two offices used self-instruction — such as reading memos from VBA central office — 
for about 10 percent of their training, and no office used videos for more than 1 per- 
cent of their training. The central office usually communicates immediate policy and 
regulatory changes through memos called Fast Letters, which may be discussed in 
team meetings or may just be read by staff individually. 
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Figure 3 — Most Fiscal Year 2007 Training Hours Completed by 
Claims Processors in the Offices We Visited Were in the 
Form of Classroom Instruction 
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Staff Are Not Held Accountable for Meeting Their Training Requirement 

Because the agency has no policy outlining consequences for individual staff who 
do not complete their 80 hours of training per year, individual staff are not held 
accountable for meeting their annual training requirement, and at present, VBA 
central office lacks the ability to track training completed by individual staff mem- 
bers. According to VBA officials, however, the agency is in the process of imple- 
menting an automated system that should allow it to track the training each staff 
member completes. Officials reported that this system is expected to be imple- 
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merited during fiscal year 2008. VBA officials reported that this system will be able 
to record the number of training hours and the courses completed for each indi- 
vidual, staff position, and regional office. One official said the central office and re- 
gional office supervisors will have the ability to monitor training completed by indi- 
vidual staff members, but that central office will likely not monitor the training 
completed by each individual staff member, even though it may monitor the training 
records for a sample of staff members. Furthermore, despite the absence of a VBA- 
wide tracking system, managers in two of the regional offices we visited reported 
using locally developed tracking methods to determine the number of training hours 
their staff had completed. 

While individuals are not held accountable, VBA reported taking some steps to 
ensure that staff complete the required number of training hours. VBA central office 
periodically reviews the aggregated number of training hours completed at each re- 
gional office to determine whether the office is on track to meet the training require- 
ment. 8 According to a VBA official, managers in offices where the staff is not on 
track to complete 80 hours of training during the year can be reprimanded by a 
higher-level manager, and if their staff do not meet the aggregate training hours 
at the end of the fiscal year, managers could face negative consequences in their 
performance assessments. 

VBA Is Taking Steps To Strategically Plan Its Training for Staff, But Does 
Not Adequately Evaluate Training and May Be Falling Short in Design 
and Implementation 

VBA is taking steps to strategically plan its training for VSRs and RVSRs includ- 
ing the establishment of a training board to assess VBA’s training needs. VBA has 
also made some effort to evaluate its training for new staff, but does not require 
regional offices to collect feedback from staff on any of the training they provide. 
Although some regional offices collect some training feedback, it is not shared with 
VBA central office. Both new and experienced staff we interviewed did, in fact, re- 
port some problems with their training. A number of new staff raised issues with 
how consistently their training curriculum was implemented. Experienced staff dif- 
fered in their assessments of the VBA’s annual training requirement, with some in- 
dicating they struggle to meet this requirement because of workload pressures or 
that training topics are sometimes redundant or not relevant to their position. 

VBA Is Taking Steps To Strategically Plan Its Training 

VBA is taking steps to strategically plan its training for claims processors, in ac- 
cordance with generally accepted practices identified by GAO. (See app. I for a de- 
tailed description of these generally accepted practices.) 

Aligning Training with the Agency’s Mission and Goals 

VBA has made an effort to align training with the agency’s mission and goals. 
According to VBA documents, in fiscal year 2004 an Employee Training and Learn- 
ing Board (board) was established to ensure that training decisions within the VBA 
are coordinated; support the agency’s strategic and business plans, goals and objec- 
tives; and are in accordance with the policy and vision of VBA. 9 Some of the board’s 
responsibilities include establishing training priorities and reviewing regional office 
and annual training plans. 

Identifying the Skills and Competencies Needed by the Workforce 

VBA has identified the skills and competencies needed by VBA’s claims processing 
workforce. VBA developed a decision tree and task analysis of the claims process, 
which GAO experts in the field of training told us made it possible to understand 
and map both the claims process and the decisions associated with it that supported 
the development of VBA’s training curriculum. 

Determining the Appropriate Level of Investment in Training and 
Prioritizing Funding 

VBA is taking steps to determine the appropriate level of investment in training 
and prioritize funding. According to VBA documents, some of the board’s respon- 
sibilities include developing annual training budget recommendations and identi- 
fying and recommending training initiatives to the Under Secretary of Benefits. 


8 To determine if VSRs and RVSRs in a regional office are generally meeting their annual 
training requirement, the aggregate number of training hours completed in a given year by all 
staff in that office is divided by the number of staff in that office. 

9 According to VBA officials, the board is made up of a mix of regional office and central office 
staff from different VBA business lines including Employee Development and Training, Human 
Resources, the Compensation and Pension Service, and the Insurance Service. 
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VBA officials also reported developing several documents that made a business case 
for different aspects of VBA’s training, such as VA’s annual budget and the task 
analysis of the VSR and RVSR job positions. 

Considering Government Reforms and Initiatives 

According to one VBA official, the agency identifies regulatory, statutory, and ad- 
ministrative changes as well as any legal or judicial decisions that affect how VBA 
does business and issues guidance letters, or Fast Letters, which can be sent out 
several times a year, to notify regional offices of these changes. Also, as a result 
of Congress authorizing an increase in its number of full-time employees and VBA’s 
succession planning efforts, VBA has increased the number of centralized training 
sessions for new staff and has also increased the number of Instructor Development 
Courses offered to potential centralized training instructors. As a result, VBA is tak- 
ing steps to consider Government reforms and initiatives to improve its manage- 
ment and performance when planning its training. 

VBA Collects Feedback on Centralized Training, but Regional Offices Do 
Not Always Collect Feedback on the Training They Provide 

According to accepted practices, Federal agencies should also evaluate their train- 
ing programs and demonstrate how these efforts help employees, rather than just 
focusing on activities or processes (such as number of training participants or hours 
of training). VBA has made some efforts to evaluate its training for claims proc- 
essors. During the 3-week centralized training session for new staff, VBA solicits 
daily feedback from participants using forms that experts in the training field con- 
sider well-constructed and well-balanced. According to one GAO expert, the forms 
generally employ the correct principles to determine the effectiveness of the training 
and ascertain whether the instructor effectively presented the material (see fig. 4). 
VBA officials told us that they have used this feedback to improve centralized train- 
ing for new staff. Management at one regional office cited the decision to separate 
training curricula for VSRs on Pre-determination teams and VSRs on Post-deter- 
mination teams as an example of a change based on this feedback. 
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Figure 4 — Sample of VBA’s Centralized Training Evaluation Form 
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Although VBA evaluates centralized training, it does not require regional offices 
to obtain feedback from participants on any of the training they provide to new and 
experienced staff. In a previous GAO report, VA staff told us that new training ma- 
terials they develop are evaluated before being implemented. 10 However, none of the 
regional offices we visited consistently collect feedback on the training they conduct. 


10 GAO, Veterans’ Benefits: Improved Management Would Enhance VA’s Pension Program, 
GAO-08-112 (Washington, DC: Feb. 14, 2008). 
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Supervisors from three of the regional offices we visited told us that they collect 
feedback on some of the training their office conducts, but this feedback largely con- 
cerns the performance of the instructor. Participants are generally not asked for 
feedback on course content. Moreover, regional offices we visited that do, to some 
degree, collect feedback do not share this information with VBA. 

VBA’s Training Curriculum for New Staff Appears Generally Well Designed, 
but Some Staff Raised Issues Concerning Its Implementation 

According to GAO experts in the training field, VBA’s training curriculum for new 
staff appears well designed. VBA’s curriculum for new staff conforms to adult learn- 
ing principles, carefully defining all pertinent terms and concepts, and providing 
abundant and realistic examples of claims work. GAO experts also determined that 
VBA’s training for those who teach the curriculum for new staff was well designed 
and would enable experienced claims processors to become competent trainers be- 
cause they are coached on teaching theory and have multiple opportunities to prac- 
tice their teaching skills and receive feedback. 

Many of the new staff at all four sites we visited reported that centralized train- 
ing provided them with a good foundation of knowledge and prepared them for addi- 
tional training conducted by their regional office. Also, regional office managers 
from three offices we visited told us that centralized training affords new staff the 
opportunity to network with other new staff at different regional offices, which im- 
bues a sense of how their positions fit in the organization. However, some staff re- 
ported that VBA’s implementation of their centralized training was not always con- 
sistent. A number of staff at three regional offices reported that during their cen- 
tralized training the instructors sometimes taught different ways of performing the 
same procedures or disagreed on claim procedures. Regional office officials told us 
that while centralized training instructors attempt to teach consistently through the 
use of standardized training materials, certain procedures can be done differently 
in different regional offices while adhering to VBA policy. For example, regional of- 
fices may differ on what to include in veteran notification letters. VBA officials also 
told us that centralized training conducted at the regional offices may not be as con- 
sistent as centralized training conducted at the Veterans Benefits Academy. Accord- 
ing to these officials, unlike the regional offices, the Veterans Benefits Academy has 
on-site training experts to guide and ensure that instructors are teaching the cur- 
riculum consistently. 

New staff also gave mixed assessments about how training was conducted at their 
home office after they returned from centralized training. While some staff at all 
of the regional offices we visited told us that the additional training better prepared 
them to perform their jobs, with on-the-job training identified as a useful learning 
tool, others told us that the training could not always be completed in a timely man- 
ner due to regional office priorities. Some management and staff at two of the re- 
gional offices we visited reported that, because of workload pressures, some of their 
RVSRs had to interrupt their training to perform VSR duties. Also, a few new staff 
indicated that VBA’s TPSS was somewhat difficult to use. 11 Although TPSS was de- 
veloped to provide consistent technical training designed to improve the accuracy of 
claims ratings, a number of staff at all of the regional offices we visited reported 
that TPSS was too theoretical. For example, some staff said it provided too much 
information and no practical exercises in applying the knowledge. Some staff also 
noted that certain material in TPSS was out-of-date with policy changes such as 
how to order medical examinations. Some staff at three of the regional offices also 
reported that TPSS was not always useful in training staff, in part, because TPSS 
does not use real cases. Three of the regional offices reported using TPSS for less 
than 1 percent of their training and VSRs at one regional office were unaware of 
what TPSS was. 

Experienced Staff Expressed Mixed Views of the Design and Implementa- 
tion of Their Training 

At all of the regional offices we visited, staff we spoke with generally noted that 
training enables them to keep up-to-date on changes in laws and regulations as well 
as provides opportunities for obtaining refresher training on claims procedures they 
perform infrequently. However, regional office staff we spoke with differed in their 
assessment of the 80-hour requirement. Some regional office staff said the number 


11 In 2001, GAO reported that VBA’s TPSS may not fully achieve its objectives of providing 
standardized training to new employees, reducing the training period required for new employ- 
ees, or improving claims-processing accuracy and consistency. In the report, we recommended 
actions the agency should consider in providing timely standardized training and providing indi- 
cators of the impact of TPSS on accuracy and consistency. In its technical comments on this 
report, VA indicated it accomplished the first recommendation. See GAO-01-601. 
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of training hours required was appropriate, while others suggested that VBA adopt 
a graduated approach, with the most experienced staff being required to complete 
fewer hours than new staff. VBA officials told us that, in 2007, the Compensation 
and Pension Service reviewed their annual training requirements and determined 
the 80-hour annual training requirement was appropriate. However, the officials we 
spoke with could not identify the criteria that were used to make these determina- 
tions. Furthermore, VBA management does not systematically collect feedback from 
staff evaluating the usefulness of the training they must receive to meet this re- 
quirement. Consequently, when determining the appropriateness of the 80-hour re- 
quirement, VBA has not taken into account the views of staff to gauge the effect 
the requirement has on them. 

Experienced staff had mixed views on training provided by the regional office. 
Staff at three regional offices said the core technical training topics set by the Com- 
pensation and Pension Service are really designed for newer staff and do not change 
much from year to year, and therefore experienced staff end up repeating courses. 
Also, a number of staff at all of the regional offices we visited told us some regional 
office training was not relevant for those with more experience. Conversely, other 
regional office staff note that although training topics may be the same from year 
to year, a person can learn something new each time the course is covered. Some 
VBA officials and regional office managers also noted that some repetition of courses 
is good for several reasons. Staff may not see a particular issue very often in their 
day-to-day work and can benefit from refreshers. Also, regional office managers at 
one office told us that the core technical training topics could be modified to reflect 
changes in policy so that courses are less repetitive for experienced staff. 

Many experienced staff also reported having difficulty meeting the 80-hour annual 
training requirement due to workload pressures. Many of the experienced staff we 
spoke with, at each of the regional offices we visited, told us that there is a constant 
struggle between office production goals and training goals. For example, office pro- 
duction goals can affect the availability of the regional office’s instructors. A number 
of staff from one regional office noted that instructors were unable to spend time 
teaching because of their heavy workloads and because instructors’ training prepa- 
ration hours do not count toward the 80-hour training requirement. Staff at another 
regional office told us that, due to workload pressures, staff may rush through train- 
ing and may not get as much out of it as they should. 

Performance Management System for Claims Processors Generally Con- 
forms to Accepted Practices, but May Not Clearly Differentiate Be- 
tween Performance Levels 

VA’s performance management system for claims processors is consistent with 
several accepted practices for effective performance management systems in the 
public sector, but may not clearly differentiate between staffs overall performance 
levels. VA’s performance management system aligns individual performance ele- 
ments with broader organizational performance measures, provides performance 
feedback to staff throughout the year, and emphasizes collaboration. However, the 
system may not clearly differentiate VSRs’ and RVSRs’ varying levels of perform- 
ance. While the system has five summary rating categories for VSRs and RVSRs, 
several VBA managers told us that, because of a problem with the formula used to 
convert ratings on individual performance elements into an overall performance cat- 
egory, it is more difficult for staff to be placed in certain categories than others. 

Performance Management System for Claims Processors Is Generally Con- 
sistent With Accepted Practices 

The elements used to evaluate individual VSRs’ and RVSRs’ performance appear 
to be generally aligned with VBA’s organizational performance measures, something 
prior GAO work has identified as a well-recognized practice for effective perform- 
ance management systems (see app. I). Aligning individual and organizational per- 
formance measures helps staff see the connection between their daily work activities 
and their organization’s goals and the importance of their roles and responsibilities 
in helping to achieve these goals. VSRs must be evaluated on four critical elements: 
quality, productivity, workload management, and customer service. RVSRs are eval- 
uated on quality, productivity, and customer service. In addition, VBA central office 
requires regional offices to evaluate their staff on at least one non-critical element. 
The central office has provided a non-critical element called cooperation and organi- 
zational support, and although regional offices are not required to use this par- 
ticular element, all four offices we visited did so (see table 2). For each element, 
there are three defined levels of performance: exceptional, fully successful, or less 
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than fully successful. 12 Table 2 refers only to the fully successful level of perform- 
ance for each element. 

Table 2 — Individual Performance Elements for VSRs and RVSRs 


Performance 

element 

How Performance is evaluated 

Standard for 
minimum fully 
successful 
performance 
(journey-level VSR) 

Standard for 
minimum fully 
successful 
performance 

0 ourney-level 
RVSR) 

Critical 




Quality 

A random selection of 5 cases 
or phone calls per month is 
reviewed for accuracy based 
on certain criteria, for exam- 
ple whether all necessary 
evidence was requested, 
proper notifications were 
sent to applicants, and accu- 
rate information was pro- 
vided in phone calls. Any 
case or phone call with one 
or more errors is counted as 
one inaccurate case or call. 

85% accuracy 

85% accuracy 

Productivity 

Number of weighted actions 
(VSRs) or weighted cases 
(RVSRs) completed per day. 
VSRs receive different 

weights for different actions, 
such as 0.125 for conducting 
a telephone interview or 1.50 
for developing the evidence 
for a claim with a special 
issue such as radiation. 
RVSRs receive different lev- 
els of credit for processing 
cases with different numbers 
of issues to be evaluated. 

8 weighted actions 
per day a 

3.5 weighted 
cases per day b 

Customer service 

Number of valid complaints 
about employee’s behavior 
from external customers or 
internal colleagues. 

No more than 3 valid complaints or in- 
cidents 

Workload 

management 

Completion of designated tasks 
in a timely manner, such as 
obtaining the results of a 
medical exam within a speci- 
fied period of time. 

Tasks are com- 
pleted in timely 
manner 85 per- 
cent of the time 

Not applicable 

Non-critical c 




Cooperation and 
organizational 
support 

Understanding of agency goals, 
interaction with colleagues, 
contribution to agency goals. 

Interacts with colleagues profes- 
sionally. Follows directions and ad- 
heres to guidance conscientiously. Ad- 
justs easily to different working styles 
and perspectives. 


Source: GAO analysis of VBA information. 

Note: This table includes the levels set for journey-level VSRs and RVSRs, who are considered 
experienced and fully trained in their positions. For some elements VBA sets different perform- 
ance standards for entry-level and experienced claims processors. For example, VSRs are typi- 
cally promoted to the journey-level position after about 2 years. VBA has separate, lower per- 
formance standards in the accuracy, productivity, and workload management elements for VSRs 
who are not yet at the journey level. Also, regional offices have the option of setting fully suc- 
cessful levels for their staff that are higher than the national minimum, but not lower. This 
table indicates instances when the regional offices we visited have set thresholds that are higher 
than the national minimum. 


12 The central office has set a minimum performance level for each element that defines the 
fully successful level of performance. Regional offices may set higher fully successful levels for 
their staff, and three of the offices we visited had set a higher level for at least one element. 
Regional offices also have discretion to set the level for exceptional performance in each element 
for their staff. 
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a Milwaukee has set a fully successful level of 10 weighted actions per day. 

b Baltimore, Milwaukee, and Portland have set fully successful levels of, respectively, 4, 5, and 
3.8 weighted cases per day. 

c Regional offices are required to use at least one non-critical element. VBA central office pro- 
vided regional offices with the cooperation and organizational support element, but regional of- 
fices are not required to use this element in particular. 

Three critical elements in particular — quality, workload management, and produc- 
tivity — are aligned with VBA’s organizational performance measures (see table 3). 
According to VA’s strategic plan, one key organizational performance measure for 
VBA is overall accuracy in rating disability claims. This organizational measure is 
aligned with the quality element for VSRs and RVSRs, which is assessed by meas- 
uring the accuracy of their claims-processing work. An individual performance ele- 
ment designed to motivate staff to process claims accurately should, in turn, help 
VBA meet its overall accuracy goal. Two other key performance measures for VBA 
are the average number of days that open disability claims have been pending and 
the average number of days it takes to process disability claims. VSRs are evaluated 
on their workload management, a measure of whether they complete designated 
claims-related tasks within specific deadlines. Individual staff performance in this 
element is linked to the agency’s ability to manage its claims workload and process 
claims within goal timeframes. Finally, a performance measure that VBA uses to 
evaluate the claims-processing divisions within its regional offices — and that, ac- 
cording to VBA, relates to the organization’s overall mission — is production, or the 
number of compensation and pension claims processed by each office in a given time 
period. Individual VSRs and RVSRs are evaluated on their productivity, i.e., the 
number of claims-related tasks they complete per day. Higher productivity by indi- 
vidual staff should result in more claims being processed by each regional office and 
by VBA overall. 


Table 3 — Performance Elements for VSRs and RVSRs and 
Corresponding Organizational Performance Measures for VBA 


Performance element 
for VSRs and RVSRs 

Corresponding VBA performance measure (s) 

Quality 

Accuracy rate for ratings of compensation claims 

Productivity 

Number of compensation and pension claims completed by 
the claims-processing division within a regional office in 
a given time period 

Workload management a 

Average days pending for compensation and pension claims 

(average number of days since claim was received by VBA, 
for all open claims) 

Average days to process compensation and pension claims 
(average number of days from receipt of claim to final deci- 
sion) 


Source: VBA and GAO analysis. 

a Workload management element applies only to VSRs, not RVSRs. 


The performance management system for VSRs and RVSRs also appears to be 
consistent with several other accepted practices for performance management sys- 
tems in the public sector: 

Providing and Routinely Using Performance Information to Track Organi- 
zational Priorities 

Providing objective performance information to individuals helps show progress in 
achieving organizational goals and allows individuals to manage their performance 
during the year by identifying performance gaps and improvement opportunities. 
Regional offices are supposed to use the critical and non-critical performance ele- 
ments to evaluate and provide feedback to their staff. Supervisors are required to 
provide at least one progress review to their VSRs and RVSRs each year, indicating 
how their performance on each element compares to the defined standards for fully 
successful performance. In the offices we visited, supervisors typically provide some 
feedback to staff on a monthly basis. For example, VSRs in the Atlanta regional of- 
fice receive a memo on their performance each month showing their production in 
terms of average weighted actions per day, their accuracy percentage based on a re- 
view of a sample of cases, and how their performance compared to the minimum 
requirements for production and accuracy. If staff members fall below the fully sue- 
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cessful level in a critical element at any time during the year, a performance im- 
provement plan must be implemented to help the staff member improve. 

Connecting Performance Expectations to Crosscutting Goals 

Performance elements related to collaboration or teamwork can help reinforce be- 
haviors and actions that support crosscutting goals and provide a consistent mes- 
sage to all employees about how they are expected to achieve results. VSR and 
RVSR performance related to customer service is evaluated partly based on whether 
any valid complaints have been received about a staff member’s interaction with 
their colleagues. And performance related to the cooperation and organizational sup- 
port element is based on whether staff members’ interaction with their colleagues 
is professional and constructive. 

Using Competencies to Provide a Fuller Assessment of Performance 

Competencies, which define the skills and supporting behaviors that individuals 
are expected to exhibit to carry out their work effectively, can provide a fuller as- 
sessment of an individual’s performance. In addition to elements that are evaluated 
in purely quantitative terms, VBA uses a cooperation and organizational support 
element for VSRs and RVSRs that requires supervisors to assess whether their staff 
are exhibiting a number of behaviors related to performing well as a claims proc- 
essor. 

Involving Employees and Stakeholders to Gain Ownership of the Perform- 
ance Management System 

Actively involving employees and stakeholders in developing the performance 
management system and providing ongoing training on the system helps increase 
their understanding and ownership of the organizational goals and objectives. For 
example, VA worked with the union representing claims processors to develop an 
agreement about its basic policies regarding performance management. Also, VBA 
indicated that it planned to pilot revisions to how productivity is measured for VSRs 
in a few regional offices, partly so VSRs would have a chance to provide feedback 
on the changes. 

VA’s System May Not Clearly Differentiate Between Performance Levels 

Clear differentiation between staff performance levels is also an accepted practice 
for effective performance management systems. Systems that do not result in mean- 
ingful distinctions between different levels of performance fail to give (1) employees 
the constructive feedback they need to improve, and (2) managers the information 
they need to reward top performers and address performance issues. GAO has pre- 
viously reported that, in order to provide meaningful distinctions in performance for 
experienced staff, agencies should use performance rating scales with at least three 
levels, and scales with four or five levels are preferable because they allow for even 
greater differentiation between performance levels. 13 If staff members are con- 
centrated in just one or two of multiple performance levels, however, the system 
may not be making meaningful distinctions in performance. 

VA’s performance appraisal system has the potential to clearly differentiate be- 
tween staff performance levels. Each fiscal year, regional offices give their staff a 
rating on each critical and non-critical performance element using a three-point 
scale — exceptional, fully successful, or less than fully successful. Based on a VA- 
wide formula, the combination of ratings across these elements is converted into one 
of VA’s five overall performance levels: outstanding, excellent, fully successful, mini- 
mally satisfactory, and unsatisfactory (see fig. 5). Regional offices may award finan- 
cial bonuses to staff on the basis of their end-of-year performance category. 14 Prior 
to fiscal year 2006, VA used two performance levels — successful and unacceptable — 
to characterize each staff member’s overall performance. To better differentiate be- 
tween the overall performance levels of staff, VA abandoned this pass-fail system 
in that year, choosing instead to use a five-level scale. 


13 See GAO, Human Capital: Preliminary Observations on the Administration’s Draft Pro- 
posed “Working for America Act,” GAO— 06— 142T (Washington, DC: Oct. 5, 2005). 

14 In three of the four offices we visited, staff members placed in the outstanding and excellent 
categories receive bonuses, and in one of these offices some staff in the fully successful category 
also receive bonuses. 
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Figure 5 — VA Overall Performance Appraisal Formula 


FHaEiripi i?n 

Critical 

Elem-cnrl-s 

¥ W 

MM lair^lAUL- 


fl-Ml ngs on 
Non Critical 
CltirwirlB 

W V 

tiHf All «e*Akhi 


*|fltXi!P*nivils Ml 


Ora or iron iUV 
fvcmstuitfj ft 

rJIWH rawviwi.’ir 


'■ i ■ r p i " ■ ■ an 

at isaphi'ttt 


ll m rr mow Lu i 
rtLvr L.f r 



■nif 


*!l'1 


neTfi Ab>¥ 
■UTJuwtJiX 1 Hr^p 

ofwni r*.? -hi ' V-.J '.-L l i 


All MVAuvuAiU* 
I ft LSL VftiftMtl 


UlFJ 41 TFlIt' li-il 
■ntnfiA^ 


Owrall 
Purl or ran nee 

CatEqcry 

¥ ¥ 

*■ cyiKardrQ 


► Extdlcnl 


Pills SlluS-li'j 

MniralV 
*■ SktriWHHy 


+• UrtsDlHlKlDrv 


Source: GAO analysis of VBA information. 

However, there is evidence to suggest that the performance management system 
for VSRs and RVSRs may not clearly or accurately differentiate among staffs per- 
formance. VBA central office officials and managers in two of the four regional of- 
fices we visited raised concerns with VA’s formula for translating ratings on indi- 
vidual performance elements into an overall performance rating. 15 These officials 
said that under this formula it is more difficult for staff to be placed in certain over- 
all performance categories than others, even if staffs performance truly does fall 
within one of those categories. Indeed, at least 90 percent of all claims processors 
in the regional offices we visited were placed in either the outstanding or the fully 
successful category in fiscal year 2007. (Fig. 6 shows the distribution of overall per- 
formance ratings for claims processors in each office.) 16 


15 Officials in the other two offices we visited reported no problems with the performance ap- 
praisal formula. Officials in one of these offices told us the current five-level system provides 
more flexibility than the previous pass/fail system. 

16 We asked VA for fiscal year 2007 performance appraisal data for VSRs and RVSRs nation- 
ally to determine whether the distribution of staff across overall performance categories is simi- 
lar at the national level. While VA indicated that it collects performance appraisal data for re- 
gional office staff, the agency was unable to provide us with appraisal data specifically for VSRs 
and RVSRs, as these positions are part of a broader job series. 
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Figure 6 — Fiscal Year 2007 Overall Performance Ratings for Claims 
Processors in Four Regional Offices Were Concentrated 
in the Outstanding and Fully Successful Categories 
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Central and regional office managers noted that, in particular, it is difficult for 
staff to receive an overall rating of excellent. Managers in one office said there are 
staff whose performance is better than fully successful but not quite outstanding, 
but under the formula it is difficult for these staff to be placed in the excellent cat- 
egory as the managers feel they should be. An excellent rating requires exceptional 
ratings in all the critical elements and a fully successful rating in at least one non- 
critical element. However, according to staff we interviewed, virtually all staff who 
are exceptional in the critical elements are also exceptional in all non-critical ele- 
ments), so they appropriately end up in the outstanding category. On the other 
hand, the overall rating for staff who receive a fully successful rating on just one 
of the critical elements — even if they are rated exceptional in all the other ele- 
ments — drops down to fully successful. Managers in one regional office commented 
that the system would produce more accurate overall performance ratings if staff 
were given an overall rating of excellent when they had, for example, exceptional 
ratings on three of five overall elements and fully successful ratings on the other 
two. 

An official in VA’s Office of Human Resources Management acknowledged that 
there may be an issue with the agency’s formula. Although neither VBA nor VA cen- 
tral office officials have examined the distribution of VSRs and RVSRs across the 
five overall performance ratings, VA indicated it is considering changes to the sys- 
tem designed to allow for greater differentiation in performance ratings. For exam- 
ple, one possible change would be to use a five-point scale for rating individual ele- 
ments — probably mirroring the five overall performance rating categories of out- 
standing, excellent, fully successful, minimally satisfactory, and unsatisfactory — 
rather than the current three-point scale. Under the proposed change, a staff mem- 
ber who was generally performing at the excellent but not outstanding level could 
get excellent ratings in all the elements and receive an overall rating of excellent. 
This change must still be negotiated with several stakeholder groups, according to 
the VA official we interviewed. 

Conclusions 

In many ways, VBA has developed a training program for its new staff that is 
consistent with accepted training practices in the Federal Government. However, be- 
cause VBA does not centrally evaluate or collect feedback on training provided by 
its regional offices, it lacks the information needed to determine if training provided 
at regional offices is useful and what improvements, if any, may be needed. Ulti- 
mately, this information would help VBA determine if 80 hours of training annually 
is the right amount, particularly for its experienced staff, and whether experienced 
staff members are receiving training that is relevant for their positions, identifying 
the right amount of training is crucial for the agency as it tries to address its claims 
backlog. An overly burdensome training requirement needlessly may take staff away 
from claims processing, while too little training could contribute to processing inac- 
curacies. Also, without collecting feedback on regional office training, VBA may not 
be aware of issues with the implementation of its TPSS, the online training tool de- 
signed to ensure consistency across offices in technical training. Setting aside the 
issue of how many hours of training should be required, VBA does not hold its staff 
accountable for fulfilling their training requirement. As a result, VBA is missing an 
opportunity to clearly convey to staff the importance of managing their time to meet 
training requirements as well as production and accuracy goals. With the implemen- 
tation of its new learning management system, VBA should soon have the ability 
to track training completed by individual staff members, making it possible to hold 
them accountable for meeting the training requirement. 

As with its training program for VSRs and RVSRs, the VA is not examining the 
performance management system for claims processors as closely as it should. VBA 
is generally using the right elements to evaluate its claims processors’ performance, 
and the performance appraisals have the potential to give managers information 
they can use to recognize and reward higher levels of performance. However, evi- 
dence suggests the formula used to place VSRs and RVSRs into overall performance 
categories may not clearly and accurately differentiate among staffs performance 
levels. Absent additional examination of the distribution of claims processors among 
overall performance categories, VA lacks a clear picture of whether its system is 
working as intended and whether any adjustments are needed. 

Recommendations for Executive Action 

The Secretary of Veterans Affairs should direct VBA to: 

• Collect and review feedback from staff on the training conducted at the regional 
offices to determine 
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• if the 80-hour annual training requirement is appropriate for all VSRs 
and RVSRs; 

• the extent to which regional offices provide training that is relevant to 
VSRs’ and RVSRs’ work, given varying levels of staff experience; and 

• whether regional offices find the TPSS a useful learning tool and, if not, 
what adjustments are needed to make it more useful; and 

• Use information from its new learning management system to hold individual 
VSRs and RVSRs accountable for completing whatever annual training require- 
ment it determines is appropriate. 

The Secretary of Veterans Affairs should also examine the distribution of claims 
processing staff across overall performance categories to determine if its perform- 
ance appraisal system clearly differentiates between overall performance levels, and 
if necessary adjust its system to ensure that it makes clear distinctions. 

Agency Comments 

We provided a draft of this report to the Secretary of Veterans Affairs for review 
and comment. In VA’s written comments (see app. IV), the agency agreed with our 
conclusions and concurred with our recommendations. For example, VBA plans to 
consult with regional office staff to evaluate its annual 80-hour training requirement 
and will examine if staff performance ratings clearly differentiate between overall 
performance levels. VA also provided technical comments that were incorporated as 
appropriate. 

We are sending copies of this report to the Secretary of Veterans Affairs, relevant 
congressional Committees, and others who are interested. We will also provide cop- 
ies to others on request. The report is also available at no charge on GAO’s Web 
site at http://www.gao.gov. 

Please contact me on (202) 512-7215 if you or your staff have any questions about 
this report. Contact points for the Offices of Congressional Relations and Public Af- 
fairs may be found on the last page of this report. Key contributors are listed in 
appendix V. 

Sincerely, 

Daniel Bertoni 
Director, Education, Workforce, and 
Income Security Issues 


Appendix I: Objectives, Scope, and Methodology 

We were asked to determine: (1) What training is provided to new and experi- 
enced claims processors and how uniform is this training? (2) To what extent has 
the Veterans Benefits Administration (VBA) developed a strategic approach to plan- 
ning training for claims processors and how well is their training designed, imple- 
mented, and evaluated? And (3) To what extent is the performance management 
system for claims processors consistent with generally accepted performance man- 
agement practices in the public sector? To answer these questions, we reviewed doc- 
uments and data from the central office of the Department of Veterans Affairs’ Vet- 
erans Benefits Administration (VBA) and interviewed VBA central office officials. 
We conducted site visits to and collected data from four VBA regional offices, and 
visited the Veterans Benefits Academy. We also interviewed officials from the Amer- 
ican Federation of Government Employees, the labor union that represents Veterans 
Service Representatives (VSR) and Rating Veterans Service Representatives 
(RVSR). We compared VBA’s training and performance management systems to ac- 
cepted human capital principles and criteria compiled by GAO. We conducted this 
performance audit from September 2007 through May 2008 in accordance with gen- 
erally accepted Government auditing standards. Those standards require that we 
plan and perform the audit to obtain sufficient, appropriate evidence to provide a 
reasonable basis for our findings and conclusions based on our audit objectives. We 
believe that the evidence obtained provides a reasonable basis for our findings and 
conclusions based on our audit objectives. 

Regional Office Site Visits 

We conducted site visits to 4 of VBA’s 57 regional offices — Atlanta; Baltimore; Mil- 
waukee; and Portland, Oregon. We judgmentally selected these offices to achieve 
some diversity in geographic location, number of staff, and claims processing accu- 
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racy rates, and what we report about these sites may not necessarily be representa- 
tive of any other regional offices or all regional offices (see fig. 7). 17 

Figure 7 — Regional Offices Selected for Site Visits 
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a Full-time equivalents as of September 2007. 
b Rank among all 57 regional offices. 

c Claims-processing accuracy rate for the period of August 1, 2006 to July 31, 2007. 

During our site visits, we interviewed regional office managers, supervisors of 
VSRs and RVSRs, VSRs, and RVSRs about the training and performance manage- 
ment practices in their offices. The VSRs and RVSRs we interviewed at the four re- 
gional offices had varying levels of experience at VBA. Regional office managers se- 
lected the staff we interviewed. We also observed a demonstration of VBA’s online 
learning tool, the Training and Performance Support System (TPSS), and collected 
data from the regional offices on, for example, the training they provided during fis- 
cal year 2007. 18 In conjunction with our visit to the Baltimore regional office, we 


17 To determine each office’s accuracy performance in fiscal year 2007, we used data obtained 
from VBA’s Systematic Technical Accuracy Review (STAR) system. In an earlier GAO report, 
Veterans’ Benefits: Further Changes in VBA’s Field Office Structure Could Help Improve Dis- 
ability Claims Processing, GAO-06-149 (Washington, DC: Dec. 9, 2005), we identified problems 
that affected the use of the STAR data to make distinctions in accuracy among regional offices. 
However, for the purposes of site selection for our current review, we judged the STAR data 
to be sufficiently reliable. We made this determination based on a sensitivity analysis we did 
on earlier year data that considered sampled cases that were not sent in for STAR review. After 
this analysis we found that even with the existing limitations in the STAR data, Milwaukee 
and Baltimore had higher accuracy scores and Atlanta and Portland had lower accuracy scores. 
Even though the sensitivity analysis was done on earlier year data, the ranking of the four of- 
fices was similar in fiscal year 2007, showing that the offices we deemed to have higher accuracy 
scores in an earlier year still had higher accuracy scores in fiscal year 2007 and the same re- 
mained true for the offices with lower accuracy scores. 

18 One question we asked the regional offices was whether each course on their fiscal year 
2007 training plan addressed a core technical training topic. For three of the offices, the data 
we received did not cover all training hours provided during the fiscal year, but each office pro- 
vided data on at least 99 percent of its training hours. 
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also visited VBA’s Veterans Benefits Academy, where we observed classes for VSRs 
and RVSRs and interviewed the Director of the Academy. 

Assessment of VBA’s Training for Claims Processors 

To determine whether VBA’s training program is consistent with accepted train- 
ing practices in the public sector, we relied partly on a guide developed by GAO that 
lays out principles that Federal agencies should follow to ensure their training is 
effective. 19 This guide was developed in collaboration with Government officials and 
experts in the private sector, academia, and nonprofit organizations; and in conjunc- 
tion with a review of laws, regulations and literature on training and development 
issues, including previous GAO reports. The guide lays out the four broad compo- 
nents of the training and development process (see fig. 8). 

Figure 8 — Four Components of the Training and Development Process 
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Source: GAO 

Note: The evaluation component may include the use of participant feedback to ensure contin- 
uous improvement, as well as an assessment of the impact of training on organizational per- 
formance. We have reported that higher-level evaluations that attempt to measure the return 
on investment in a training program may not always be appropriate, given the complexity and 
costs associated with efforts to directly link training programs to improved individual and orga- 
nizational performance. 

The guide also provides key questions for Federal agencies to consider in assess- 
ing their performance in each component. (See table 4 for a sample of these ques- 
tions.) 


19 GAO, Human Capital: A Guide for Assessing Strategic Training and Development Efforts 
in the Federal Government, GAO-04-546G (Washington, DC: March 2004). 
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Table 4 — Selected Key Questions to Consider in Assessing Agency’s 
Training Program 


Planning/Front End Analysis 

• Does the agency have training goals and related per- 
formance measures that are consistent with its overall 
mission, goals, and culture? 

• How does the agency identify the appropriate invest- 
ment to provide for training and development efforts 
and prioritize funding so that the most important 
training needs are addressed first? 

Design and Development 

• What criteria does the agency use in determining 
whether to design training and development programs 
in-house or obtain these services from a contractor or 
other external source? 

• Does the agency use the most appropriate mix of cen- 
tralized and decentralized approaches for its training 
and development programs? 

Implementation 

• What steps do agency leaders take to communicate 
the importance of training and developing employees, 
and their expectations for training and development 
programs to achieve results? 

• How does the agency select employees to participate 
in training and development efforts? 

Evaluation 

• To what extent does the agency systematically plan 
for and evaluate the effectiveness of its training and 
development efforts? 

• How does the agency incorporate evaluation feedback 
into the planning, design, and implementation of its 
training and development efforts? 


Source: GAO. 


In addition, GAO training experts reviewed VBA materials, including training 
curricula, lesson plans, and course evaluation forms, to determine if these materials 
are consistent with accepted training practices. 

Assessment of VBA’s Performance Management System for Claims Proc- 
essors 

In assessing the performance management system for VSRs and RVSRs, we relied 
primarily on a set of accepted practices of effective public sector performance man- 
agement systems that has been compiled by GAO. 20 To identify these accepted prac- 
tices, GAO reviewed its prior reports on performance management that drew on the 
experiences of public sector organizations both in the United States and abroad. For 
the purpose of this review, we focused on the six accepted practices most relevant 
for VBA’s claims-processing workforce (see table 5). 

Table 5 — Selected Accepted Practices for Effective Performance 
Management Systems 


Practice 

Description 

Aligning individual perform- 
ance expectations with orga- 
nizational goals 

Explicitly aligning individuals’ daily activities with 
broader results helps individuals see the connection 
between their work and organizational goals and en- 
courages individuals to focus on their roles and re- 
sponsibilities to help achieve those broader goals. 

Connecting performance expec- 
tations to crosscutting goals 

Fostering collaboration, interaction, and teamwork 
across organizational boundaries to achieve results 
strengthens accountability for these results. 

Providing and routinely using 
performance information to 
track organizational prior- 
ities 

Providing objective performance information to both 
managers and staff to show progress in achieving or- 
ganizational results and other priorities helps them 
manage during the year, identify performance gaps, 
and pinpoint improvement opportunities. 


20 GAO, Results-Oriented Cultures: Creating a Clear Linkage between Individual Performance 
and Organizational Success, GAO-03-488 (Washington, DC: Mar. 14, 2003). 
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Table 5 — Selected Accepted Practices for Effective Performance 
Management Systems — Continued 


Practice 

Description 

Using competencies to provide 
a fuller assessment of per- 
formance 

Using competencies, which define the skills and sup- 
porting behaviors that individuals need to effectively 
contribute to organizational results, can provide a 
fuller picture of an individual’s performance. 

Making meaningful distinc- 
tions in performance 

Providing individuals with candid and constructive feed- 
back helps them maximize their contribution, and pro- 
viding management with objective and fact-based in- 
formation that clearly differentiates between different 
levels of performance enables it to reward top per- 
formers and deal with poor performers. 

Involving employees and 
stakeholders to gain owner- 
ship of performance man- 
agement systems 

Actively involving employees and stakeholders in devel- 
oping the performance management system and pro- 
viding ongoing training on the system helps increase 
their understanding and ownership of the organiza- 
tional goals and objectives. 


Source: GAO. 


Appendix II: Fiscal Year 2007 Core Technical Training Requirements for 

VSRs and RVSRs 


Position 


Course title or topic 


Training source 


Decision Review 
Officers (DRO) 
GS 13/Rating 
Veterans Serv- 
ice Representa- 
tives (RVSR) 
GS7-12 
(Seasoned) 
Required: 80 
hours 

Any DRO or 
RVSR who con- 
ducts a training 
session will also 
be given credit 
for those train- 
ing hours as 
part of their 
training re- 
quirement. 


Effective Dates 
Diabetes Mellitus 
Leishmaniasis 

Original Compensation Ratings 
Original Pension Ratings 
Original DIC Ratings 
Rating re-opened claims 
Claims for Increase 
New and Material Evidence 
Re-opened DIC ratings 
Routine Future Exams 
3.105(e) reductions 
Paragraph 28/29/30 ratings 
Due Process Provisions 
Clear and unmistakable errors 
(3.105(a)) 

Ancillary Benefits 
Accrued Ratings 
Musculoskeletal issues 
Eye-Vision Issues 
Infectious Diseases 
Ear-Hearing 
Respiratory Disorders 
Cardiovascular Issues 
Digestive Issues 
Genitourinary System 
Gynecology 
Hemic/Lymphatic 
Endocrine (other than DM) 
Neurological 

Mental Disorder (other than 
PTSD) 

PTSD 

Special Monthly Compensation 
(SMC) 

The Appeals Process 
Responsibilities of a DRO 
Hearings 

Informal Conferences 
Resolution of Claims 
Certifying a case to BVA 
Processing Remands 
Preparing a Statement of the Case 
(SOC) 

Preparing a Supplemental 
Statement of the Case (SSOC) 

Role of the Rating Specialist 
Benefit of the Doubt 
Weighing Evidence 


C&P Training Website http://cptraining.vba.va.gov/ 
C&P_Training/RVSR/RVSR_Tng_Curr.htm 
Fast Letters 
Training Letters 
Court Decisions 

TPSS (Can be used as refresher training for sea- 
soned employees by module) 

EPSS 

Manuals 

Regulations 

Additional Issue Specific Lesson Plans are under 
development. 

(Lesson plans can be taken from the Centralized 
Training Curriculum found on the C&P Intranet 
Training Site. If used as provided they do not re- 
quire C&P review and approval. 

These plans can and often should be modified to 
focus in on a particular narrow issue of training 
need. Modified lesson plans are to be submitted to 
C&P Service for review and approval at least 30 
days prior to delivery of training. 

Any Challenge-oriented original lesson plan devel- 
oped by Station personnel is to be submitted to 
C&P Service for review and approval at least 30 
days prior to delivery of training.) 

C&P Service Broadcasts that may be provided dur- 
ing the course of the FY may be substituted in 
place of any training scheduled on an hour by 
hour basis. 
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Position 

Course title or topic 

Training source 


60 Hours of the required 80 Hours 
will be selected from the sug- 
gested topics above. The remain- 
ing 20 hours will be selected at 
the Stations discretion based 
upon their own individual qual- 
ity review. 

(Training provided from the above 
topics can be focused on a par- 
ticular aspect of the topic; i.e. 

Cold Injuries and Rating Hyper- 
tension from Cardiovascular 
issues could be separate classes) 

Participation in Agency Advance- 
ment Programs (i.e., LEAD, 

LVA) does not substitute for Re- 
quired training requirements. 


Veteran Service 
Representative 
(VSR) GS 7-12 
(Seasoned) 
Required: 80 
hours 

Any Super Senior 
VSR, Senior 

VSR, or VSR, 
who conducts a 
training session 
will also be 
given credit for 
those training 
hours including 
preparation 
time as part of 
their training 
requirement. 

Reference Materials: Manual 
Training & WARMS 

C&P Website 

Claims Folder Maintenance 

Records Management 

PO A/Service Orgs. 

Original Compensation Claims 
Re-opened Compensation Claims 

VA Form 21-526 

Establishing Veteran Status 

Claims Recognition 

Duty to Assist 

Requesting VA Exams 

Issue Specific Claims Development 
Asbestos Claims Development 
Herbicide Claims Development 

POW Claims Development 
Radiation Claims Development 
PTSD Claims Development 
Undiagnosed Illness Claims Devel- 
opment 

Dependency Issues 

Contested Claims 

Deemed Valid and Common Law 
Marriages 

Continuous Cohabitation 

Pension 

SHARE 

COVERS 

MAP D 

MAP A 

Administrative Decisions 

Character of Discharge 

Line of Duty- Willful Misconduct 
Matching Programs 

Workload Management 

DEA Training 

Intro, to Ratings 

Paragraph 29 & 30 Ratings 

Ratings & BDN 

BDN 301 Interface 

PCGL Award Letters 

Dependents and the BDN 
Compensation Offsets 

Drill Pay Waivers 

Pension Awards Processing & 

BDN 

Hospital Reductions 

Burial Benefits 

Death Pension 

Accrued Benefits 

Accrued Awards & the BDN 
Apportionments 

Special Monthly Pension 

Helpless Child 

Incompetency/Fiduciary Arrange- 
ments 

Claims Processing 

Auto Allowance and Adaptive 
Equipment 

Special Adapted Housing 

Special Home Adaptation Grants 
Incarcerated Veterans 

Processing Write Outs 

FOIA/Privacy Act 

C&P Training Website 

http://cptraining.vba.va.gov/C&P Training/VSR/ 

VSR Curriculum.htm 
or, 

http://cptraining.vba.va.gov/C&P Training/VSR/ 

VSR Curriculum.htm#pctt 

Fast Letters 

Training Letters 

Court Decisions 

TPSS (Can be used as refresher training for sea- 
soned employees by module) 

EPSS 

Manuals 

Regulations 

Federal Benefits for Veterans and Dependents 
Business Line Internet Sites 

Conference Calls (VACO/C&P Service) 

Star Reporter 

Additional Issue Specific Lesson Plans are under 
development. 

(Lesson plans can be taken from the Centralized 
Training Curriculum found on the C&P Intranet 
Training Site. If used as provided they do not re- 
quire C&P review and approval. 

These plans can and often should be modified to 
focus in on a particular narrow issue of training 
need. Modified lesson plans are to be submitted to 
C&P Service for review and approval at least 30 
days prior to delivery of training. 

Any Challenge-oriented original lesson plan devel- 
oped by Station personnel is to be submitted to 
C&P Service for review and approval at least 30 
days prior to delivery of training.) 

C&P Service Broadcasts that may be provided dur- 
ing the course of the FY may be substituted in 
place of any training scheduled on an hour by 
hour basis. 
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Position 

Course title or topic 

Training source 


Telephone & Interview Techniques 
Telephone Development 

IRIS 

Introduction to VACOLS 

Education Benefits 

Insurance Benefits 

National Cemetery 

VR&E Benefits 

Loan Guaranty Benefits 

General Benefits — FAQs 

Suicidal Caller Guidance 
Non-Receipt of BDN Payments 

Mail Handling 

Income & Net Worth Determina- 
tions 

Bootcamp test and review of VSR 
Readiness Guide (2 HRS Re- 
quired) 

Reference Material Training and 
Navigation (1 HR Required) 
Appeals and Ancillary Benefits 
Ready to Rate Development 
Customer Service 

FNOD Info and PMC Process 

Intro, to Appeals Process 

DRO Selection Letter 

Income Adjustment Materials 
Income Adjustments 

60 Hours of the required 80 Hours 
will be selected from the sug- 
gested topics above. The remain- 
ing 20 hours will be selected at 
the Stations discretion based 
upon their own individual qual- 
ity review. 


Veterans Services 
Representative 
(VSR) GS 7-12 
(New) 

Required: Entire 
Curriculum 
(Follow C&P Pre- 
scribed Cur- 
riculum for new 
VSRs, as posted 
on intranet.) 

Curriculum is posted on C&P 
Training Intranet Site 

Claims Processing Prerequisites: 
Human Resources and Orientation 
Computer Security and LAN Pro- 
cedures 

Core Values 

Core Competencies and Your Job 
Voice of the Veteran video 

VA in Motion video 

VSR Handbook 

VA Terminology 

SHARE (BDN & CEST) 

COVERS 

PIES 

Return with Honor Video 

MAPD 

AMIE/CAPRI 

Medical TPSS (Medical Termi- 
nology) 

Reader Focused Writing Tools 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#cpp 


Pre-Determination Team Training: 
Overview of VA Mission 

Reference Materials: Manual 
Training & WARMS 

C&P Website 

Claims Folder Maintenance 

Records Management 

POA/Service Organizations 
Compensation 

Original Compensation Claims 
Non-Original Compensation 

Claims 

VA Form 21—526, App. For Com- 
pensation or Pension 

Establishing Veteran Status 

Claims Recognition 

Duty to Assist 

Selecting the Correct Worksheet 
for VA Exams 

Issue Specific Claim Development 
Asbestos Claim Development 
Herbicide Claim Development 

POW Claim Development 

Radiation Claim Development 

PTSD Claim Development 
Undiagnosed Illness Claim Devel- 
opment 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#pred 
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Position 

Course title or topic 

Training source 


Dependency 

Contested Claims 

Deemed Valid and Common-law 
Marriage 

Continuous Cohabitation 

Pension 

Intro. To Disability Pension 
Overview of SHARE (SSA) 
Administrative Decision Process 
Character of Discharge 

Line of Duty — Willful Misconduct 
Claims Development 

Workload Management Utilizing 
WIPP 

DEA Training (req. added 4/06) 


Post-Determination Team Train- 
ing: 

Intro, to Ratings 

Paragraph 29 & 30 Ratings 

Ratings & the BDN 

BDN 301 Interface Video 

PCGL Award Letters 

Dependents & the BDN 
Compensation Offsets 

Drill Pay Waivers 

Star Reporter 

Pension Awards Processing & the 
BDN 

Hospital Reductions 

Burial Benefits 

Disallowance Processing 

DIC Benefits 

Death Pension 

Accrued Benefits 

Accrued Awards & the BDN 
Apportionment 

Special Monthly Pension 

Helpless Child 

Incompetency/Fiduciary Arrange- 
ments 

Claims Processing 

Automobile Allowance and Adapt- 
ive Equipment 

Specially Adapted Housing and 
Special Home Adaptation 

Grants 

Incarceration 

Processing Computer Write Outs 
DEA Training (req. added 4/06) 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#postd 

Public Contact Team Training: 
FOIA/Privacy Act 

Communication Skills 

Telephone Development 

Inquiry Routing and Information 
System (IRIS) 

Intro, to VACOLS 

Other VBA Business Lines 
Customer Service 

Insurance Education (2 hrs) 

Triage Team Training: 

FNOD Information & PMC Proc- 
essing 

Appeals Team Training: 

Intro, to Appeals Process 

VACOLS 

Pension Maintenance Centers 
Income Adjustment Materials: In- 
come Adjustments 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#pctt 

VSR Core Curriculum 

Video, VSR Curriculum 

VSR Core Curriculum 

Fast Ltr. 04-12 

VSR Core Curriculum 

Threshold Videos 

Video 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#ttt 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#att 

http://cptraining.vba.va.gov/C&P Training/vsr/ 

VSR Curriculum.htm#iam. 


Source: VBA. 
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Appendix III: Excerpts From Fiscal Year 2007 Training Plans for Four 

Regional Offices 

Each training plan we reviewed contained the same informational categories, 
some of which were what courses were offered by the regional office, whether or not 
the course was conducted, and how many employees completed the training. Al- 
though the fiscal year 2007 training plans we reviewed include data on whether and 
when the course was actually completed, the initial training plans submitted at the 
beginning of the fiscal year of course do not have this information. The lists pro- 
vided below include the first 25 courses listed on each plan alphabetically, a small 
sample of the courses that the regional offices reported they completed for the fiscal 
year. 


Table 6 — Excerpt From Atlanta Regional Office Training Plan 


Course name 

Number of 
employees 
completed 

Total hours 
of training 
completed 

Accrued Benefits 

15 

150 

Accrued Ratings (2 sessions conducted) 

47 

80 

Administrative Decisions 

15 

60 

Ancillary Benefits 

14 

14 

Appeals and Ancillary Benefits (2 sessions conducted) 

26 

41 

Apportionments (2 sessions conducted) 

29 

194 

Asbestos Claims Development 

9 

9 

Auto Allowance/Special Adapted Housing/Special Home Adap- 
tation Grant 

15 

30 

Benefits Delivery Network 301 Interface (2 sessions conducted) 

48 

48 

Beneficiary Identification Records Locator Subsystem Update 

17 

17 

Blast Injuries (2 sessions conducted) 

20 

20 

Burial Benefits (2 sessions conducted) 

36 

100 

Board of Veterans Appeals Examinations 

46 

69 

Compensation & Pension Website (2 sessions conducted) 

108 

270 

Change of Address/Power of Attorney Processing/No Record 
Mail 

17 

34 

Cardiovascular Issues 

38 

76 

Certifying a Case to Board of Veterans Appeals 

12 

12 

Character of Discharge 

78 

78 

Claims Folder Maintenance (2 sessions conducted) 

17 

28 

Claims for Direct Service Connection/Aggravation/Presumptive 
Service Connection 

34 

34 

Claims for Increase 

29 

58 

Claims Processing 

139 

69.5 

Claims Recognition 

84 

336 

Compensation Offsets (3 sessions conducted) 

167 

352.5 

Computer Security and LAN Procedures 

6 

6 


Source: VBA. 

Note: Atlanta’s training plan reported the regional office conducted a total of 133 courses for 
fiscal year 2007. 
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Table 7 — Excerpt From Baltimore Regional Office Training Plan 


Course name 

Number of 
employees 
completed 

Total hours 
of training 
completed 

Accrued Benefits 

5 

10 

Automated Medical Information Exchange/Compensation and 
Pension Record Interchange 

6 

48 

Appeals and Ancillary Benefits 

3 

3 

Asbestos Claims Development 

3 

3 

Access Standardized Performance Elements Nationwide 

2 

2 

Auto Allowance and Adaptive Equipment (2 sessions con- 
ducted) 

16 

8 

Benefits Delivery at Discharge Development 

14 

21 

Benefits Delivery Network 301 Interface (2 sessions conducted) 

5 

7 

Benefit of the Doubt 

3 

12 

Burial Benefits (2 sessions conducted) 

7 

14 

Compensation & Pension Website (3 sessions conducted) 

15 

36.5 

Certifying a Case to Board of Veterans Appeals 

3 

12 

Character of Discharge 

15 

7.5 

Claims Folder Maintenance 

7 

14 

Claims Recognition 

5 

20 

Communication — Nonverbal Cues 

3 

1.5 

Computer Security and LAN Procedures 

6 

12 

Conducting a Field Exam 

3 

1.5 

Continuous Cohabitation (2 sessions conducted) 

20 

20 

Core Values 

5 

5 

Control of Veterans Records System (3 sessions conducted) 

10 

12.5 

Customer Service (5 sessions conducted) 

40 

416 

Dealing with Difficult Payee Situations 

3 

3 

Deemed Valid and Common Law Marriages (2 sessions con- 
ducted) 

20 

12.5 

Dependency Issues (3 sessions conducted) 

22 

26.5 


Source: VBA. 

Note: Baltimore’s training plan reported the regional office conducted a total 191 courses for 
fiscal year 2007. 
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Table 8 — Excerpt From Milwaukee Regional Office Training Plan 


Course name 

Number of 
employees 
completed 

Total hours 
of training 
completed 

8824e 

i 

i 

Administrative Decisions 

14 

91 

Advanced Data Manipulation in Excel (VA Learning Online) 

1 

4 

All — Litigation Hold Memo 

130 

32.5 

All-Encryption Training 

1 

0.5 

Ancillary Benefits 

21 

42 

Auto Allowance and Adaptive Equipment 

28 

28 

Blast Injuries (Video) 

33 

33 

Board of Veterans Appeals review 

7 

14 

Compensation & Pension Website 

41 

102.5 

Claims Assistant — Burials 

4 

4 

Claims Assistant/Program Support Clerk — Power of Attorney 

24 

24 

Claims Assistant/Program Support Clerk — Share and Cest 

21 

178.5 

Claims Assistant/Program Support Clerk — Veterans Appeals 
Control and Locator System 

25 

25 

Cardiovascular Issues 

30 

180 

Challenge 07-02 Centralized Training 

6 

720 

Challenge 07-02 Post Centralized Training 

6 

1,440 

Challenge 07-02 Pre-Req. 

6 

720 

Claims Folder Maintenance 

41 

82 

Claims Recognition 

26 

26 

Character of Discharge Determinations, Line of Duty Deter- 
minations, and Administrative Decisions. 

11 

24.75 

Compensation Offsets 

27 

94.5 

Core Values 

2 

3.5 

Control of Veterans Records System (2 sessions conducted) 

2 

3 

Compensation and Pension Examination Project 

1 

18 


Source: VBA. 

Note: Milwaukee’s training plan reported the regional office conducted a total of 323 courses 
for fiscal year 2007. 
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Table 9 — Excerpt From Portland Regional Office Training Plan 


Course name 

Number of 
employees 
completed 

Total hours 
of training 
completed 

020 Development 

3 

16.5 

2007 Veterans Service Center Management Workshop 

1 

26 

3.105(e) Reductions 

15 

15 

38 CFR 3.14 & Pyramiding 

2 

0.5 

5-Tier Performance Evaluations 

7 

5.25 

8824 Preparation 

1 

5 

Absence & Leave Circular Training 

13 

13 

Account Analysis 

3 

6 

Account Audits 

3 

6 

Accrued Awards & the Benefits Delivery Network 

2 

2 

Accrued Ratings 

16 

4 

Add Dependents/Verifying Service 

18 

9 

Admin Decisions/Rebuilt/Special Monthly Compensation 

4 

18 

Administrative Decisions 

5 

2.5 

Agent Orange development 

4 

4 

Amputation Rule 

2 

0.5 

Ancillary Benefits 

28 

28 

Appeal Procedures — Refresher 

3 

5.25 

Appeals 

33 

33 

Appeals and Ancillary Benefits (3 sessions conducted) 

34 

13 

Appeals — Training and Performance Support System modules 

1 

16 

Application/ eligibility 

1 

3.5 

Apportionments (2 sessions conducted) 

4 

14.5 

Asbestos Claims Development 

23 

23 

Access Standardized Performance Elements Nationwide 

6 

6 


Source: VBA. 

Note: Portland’s training plan reported the regional office conducted a total of 509 courses for 
fiscal year 2007. 
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Appendix IV: Comments From the Department of Veterans Affairs 
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Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 
September 25, 2008 

Michael Ratajczak 

Decision Review Officer 

Cleveland Veterans Affairs Regional Office 

80 F Street, NW 

Washington, DC 20001 

Dear Mr. Ratajczak: 

In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 



109 


size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 

Sincerely, 

John J. Hall 
Chairman 


Response of Michael Ratajczak to: 

Questions From the House Committee on Veteran’s Affairs, 
Subcommittee on Disability Assistance and Memorial Affairs 

Question 1: How useful is online training as opposed to classroom style? Which 
do employees prefer? 

Response: The general experience of VBA employees is that online training is 
less useful than classroom training. Online training is extremely limited insofar as 
it is not easily conformed to the constant changes permeating VBA’s claims process. 
A computer based curriculum developed only weeks prior to an employee partici- 
pating in computer based training might be inaccurate in some aspects due to 
changes in law or policy. In addition, online training is not generally responsive to 
questions not considered by its designer. So, a question may be suggested to a VBA 
employee based upon their unique experiences and some aspect of an online cur- 
riculum but that curriculum could not provide any useful guidance on the issue pre- 
sented. 

In contrast, properly administered classroom training encourages real-time inter- 
action between the instructor and the participants, and provides immediate feed- 
back for questions presented. Moreover, classroom training can easily incorporate 
any recent changes in law, policy, or regulations into its curriculum, thereby pro- 
viding more relevant and up to date information. A classroom setting provides an 
opportunity for participants to deviate from the prepared curriculum to related top- 
ics having direct impact on their ability to perform their duties, and provides a simi- 
lar opportunity for instructors to identify and correct common misconceptions among 
participants. Properly administered classroom training provides immediate, con- 
sistent, useful and relevant guidance based upon practical concerns expressed by 
participants. It is the most efficient manner to ensure consistency in processing and 
resolving complex claims, and ultimately provides the best service to veterans. 

Of course, the foregoing comments assume that the “online training” in question 
is based upon a static format, as characterized for example by VBA’s TPSS program. 
As was suggested by some questions posed during the September 18, 2008, hearing, 
some training can be effectively presented electronically through the use of tele- 
conferencing technology. Such an approach has the advantage of providing uniform 
presentation of the subject matter to a widely dispersed audience by an authori- 
tative instructing staff. However, the utility of such training is limited by the num- 
ber of participants and the amount of available time. The danger of relying on tele- 
conference training to reach a large audience is that it cannot guarantee effective 
feedback for the concerns of every participant. 

The best approach to continuing training at VBA incorporates the most useful as- 
pects of computer based, classroom, and teleconference instruction. Such an ap- 
proach would dictate that VBA’s Central Office training staff create a standard cur- 
riculum and an electronic claims file relevant to issues identified as requiring addi- 
tional training. Central Office training staff would then distribute the electronic ma- 
terials and curriculum to instructors at each Regional Office who are certified by 
Central Office to conduct centralized training. After soliciting comments from Re- 
gional Office instructors Central Office staff could facilitate a teleconference among 
the Regional Office instructors, addressing their disparate concerns and providing 
uniform guidance as to how they should approach the materials and topics at hand. 
Finally, Regional Office instructors could provide training to adjudicators in a class- 
room setting at each Regional Office in accordance with the guidance provided by 
Central Office staff during the teleconference based upon Central Office’s approved 
curriculum and electronic claims file. Such an approach would ensure, to the extent 
possible, that training throughout VBA was uniform in approach and based upon 
a common experience and guidance from Central Office. Ultimately, institutional- 
izing uniform training based upon shared common experience will foster greater 
consistency in approach to resolving veterans claims across Regional Offices, and 
eliminate ad hoc approaches which result in disparity of entitlement determinations 
and disability evaluations. 
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Questions 2: VA reinstituted the certification exam in August. What was the re- 
sponse of employees who took the test? Did AFGE have input on the new test? 

Response: AFGE does not have any direct input on designing or scoring any cer- 
tification test promulgated by VBA. AFGE is afforded the opportunity to designate 
a representative to witness the design of certification tests and scoring workshops 
in accordance with a provision of the Master Agreement between VA and the Union. 
AFGE representatives to certification testing activities can informally express con- 
cerns to VBA management during design and scoring activities. However, in the ab- 
sence of any concession by VBA management of the validity of a concern raised by 
AFGE at a certification design or scoring workshop, AFGE has no effective means 
of directly influencing the certification process prior to its implementation. In the 
absence of an immediate concession by VBA management to a point raised by an 
AFGE representative in a certification design or scoring activity, any information 
gathered by AFGE representatives through their participation in the certification 
test design or scoring activities can only be utilized to effect certification testing 
through formal labor-management proceedings. AFGE members do serve as subject 
matter experts who write the questions for certification tests, and help determine 
essential knowledge and skills of positions that need to be tested for successful cer- 
tification. However, AFGE does not attempt to influence its membership with regard 
to their duties as subject matter experts, and does not actively encourage subject 
matter experts to report to the Union concerning policies or directions expressed by 
VBA management at any certification testing design or scoring activity. 

Our experience is that employees who pass certification testing express a general 
dissatisfaction regarding the relevance of the material tested. Employees who do not 
pass certification testing express similar dissatisfaction, and also express frustration 
that they are not provided with any meaningful feedback regarding where they need 
to improve their understanding in order to be certified. That frustration is mag- 
nified when our members consider that they can be otherwise fully successful in all 
aspects of their position, but subject to adverse action or arrested career develop- 
ment solely because if their inability to pass a certification test. 

Regardless of their success in certification testing, frustration arises among AFGE 
members when they contemplate that supervisors who evaluate their job perform- 
ance on a daily basis do not presently have any similar certification requirement. 
The certification process, at present, leaves our members with the curious potential 
to be evaluated by supervisors who are not certified to have the same level of knowl- 
edge and skill level as they do. The impact of that potential has an obvious detri- 
mental impact on the morale of our members. 

Question 3: According to DAV testimony, the Union has objected to the frequency 
and other requirements DAV suggests for testing at each phase. What are the 
AFGE objections? 

Response: Some of our concerns are expressed in the last two paragraphs of our 
response to the preceding question. 

While AFGE has no objection in principle to the concept of certification testing, 
AFGE does have concerns about the practical application of the certification process 
and the effects that flawed certification testing can have on our members. As cur- 
rently constituted, certification testing is not designed to provide VBA employees 
with any specific feedback concerning what knowledge or skills they need to im- 
prove. This is a disservice both to employees who have been successfully certified 
and want to improve their job performance, and to employees who are attempting 
to be successfully certified and want to improve their job performance. As currently 
constituted, the certification testing program is not a useful learning tool. Rather, 
it more akin to a hazing ritual which somewhat arbitrarily determines whether an 
employee can continue in their current position or ascend the career ladder. Some 
of our older members with long histories of fully successful performance evaluations 
who have many years of experience successfully serving veterans have found it dif- 
ficult to successfully complete their certification requirement because of the nature 
and format of the test. In contrast, less experienced members with recent experience 
in environments that regularly utilize standardized testing (e.g. recent college grad- 
uates) may perform adequately on certification testing, but not be as astute in serv- 
ing veterans due to their simple lack of experience. While VBA management has 
recently expressed an interest in replacing older employees with younger, more tech- 
nologically savvy employees, AFGE does not believe that interest is legitimate. Nor 
can AFGE, in service to its full membership, accept that the design of certification 
tests should favor an employee with the ability to access reference materials quickly 
over an employee who understands the correct course of action due to long experi- 
ence. AFGE does not believe that any employee who can and does successfully per- 
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form the duties of their position on a daily basis should be subject to any adverse 
employment action solely because he or she cannot successfully complete a single 
certification test. Nor does AFGE believe the measure of an employee’s timely, suc- 
cessful, respectful and full service to veterans can be made by reference to a single 
test. 

Question 4: In your statement you suggest that the productivity requirements 
are too high. On average, an experienced rater is completing 2-3 claims a day. Are 
you suggesting that’s too many? How many cases a day should a rater be able to 
adjudicate? 

Response: Rating Veterans Service Representative may, in fact complete only 2- 
3 claims per day on average. If raters were only required to complete 2 to 3 cases 
per day on average, no one could object since that requirement would be based on 
an empirically verified direct relationship between what can be accomplished and 
what is required. 

Unfortunately, VBA’s National Performance Standard for Rating Veterans Service 
Representatives requires that Journey-level RVSRs (i.e. those with two or more 
years of experience) complete a minimum of 3V2 weighted cases per day. This mis- 
fortune is amplified when one considers that the 3V2 weighted case per day require- 
ment is a floor and not a ceiling, and that individual Regional Offices are free to 
set daily performance standards for RVSRs on an ad hoc basis which exceed 3 '/a 
weighted cases per day. So, for example, Tiger Team RVSRs are required to com- 
plete 4 weighted cases per day. This misfortune becomes a tragedy, both for claims 
adjudicators and for veterans, when RVSRs who are afforded the “privilege” of par- 
ticipating in their negotiated Flexiplace agreement and work from their homes are 
required to produce even more cases in exchange for that “privilege.” This Flexiplace 
tariff is usually an additional completed case per day. Hence, the aforementioned 
Tiger Team employee would have to complete 5 cases per day in days they work 
from home in order to maintain successful performance and their eligibility to par- 
ticipate in the Flexiplace program. 

The misfortunes and tragedies described in the preceding paragraph become ab- 
surd when one contemplates how the floor of 3Vz cases per day could be justified, 
let alone any upward deviation from that productivity requirement. Regarding in- 
creased Flexiplace productivity requirements, any such requirement is either tanta- 
mount to an admission that daily supervision in the workplace is obtrusive and 
counterproductive or, that RVSRs are required to work uncompensated hours in ad- 
dition to their scheduled tour of duty in order to fulfill the requirements of their 
local Flexiplace agreements. 

With regard to the floor requirement of 3V2 cases per day, AFGE believes that 
no valid empirical evidence has ever been collected to suggest such a requirement 
is attainable with any acceptable level of accuracy. A time-study analysis was ref- 
erenced by a representative of VBA management at the September 18, 2008, Hear- 
ing and a request was made to provide a copy of that study to the Subcommittee. 
If the report of any time-study analysis has been provided to the Subcommittee, 
AFGE requests that we be provided with a copy of the document and an opportunity 
to comment on it. With respect to how many cases a day an RVSR should be able 
to adjudicate, two points are salient. First, no one can dispute that an RVSR ought, 
or should be required, to accurately resolve as many cases on any given day as he 
or she can. No specific number can be assigned as a productivity requirement on 
any given day given the disparate complexity of the claims inventory. Any average 
daily productivity requirement must be calculated based upon empirical evidence 
concerning what trained RVSRs actually produce with an acceptable degree of accu- 
racy over a 1 year period in order to be valid. 

Question 5: If training is not being offered and is not available online when it 
can be completed at anytime employees should have a mechanism to notify VA Cen- 
tral Office that such opportunity does not exist at their RO. How can employees no- 
tify managers and senior leaders that the training is not being provided or made 
available? 

Response: Such a mechanism does exist for newly hired or promoted employees 
who have recently completed the centralized portion of their Challenge Training. 
Those employees are provided with access to a website where they can provide feed- 
back to Central Office’s training staff regarding the continuing progress of their 
Challenge Training when they return to their Regional Offices. Such a mechanism 
could work if all VBA training was centralized and tracked through Central Office 
as has been suggested. The problem at present is there is no accountability for Re- 
gional Office management who fail to ensure that even the Challenge Training cur- 
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riculum is implemented after completion of the centralized portion of Challenge in- 
struction. Any such requirement would have to be made part of the Regional Office 
Director’s performance plan, and enforced on RO Directors as a performance re- 
quirement by the Office of Field Operations. In the absence of any such require- 
ment, the temptation is for Regional Office management to divert employee re- 
sources from completing their Central Office approved training program to helping 
to achieve goals that are measurements of Regional Office management’s perform- 
ance (e.g. inventory reduction). The end result of this dysfunction is that newly 
hired or promoted employees never complete a uniform course of training, and their 
approach to claims processing activities is determined by the experiences they re- 
ceive at their particular Regional Office as opposed to a common, centrally approved 
experience. The ultimate detrimental consequent is that consistency and equality of 
adjudication and evaluation of veterans’ claims is not achieved. 

As the situation now stands, employees can only notify their supervisors that 
their training has been lacking when they are put on notice that they are being sub- 
jected to a performance improvement plan or some adverse employment action. At 
that point, the employee should be given a meaningful opportunity to participate in 
identifying where their weaknesses are and how those weaknesses can be addressed 
through training. Unfortunately, the weakness most often identified by management 
in such circumstances is a lack of productivity, and the only means to increase pro- 
ductivity in the absence of a sound basic understanding of the laws and regulations 
governing the administration of VA benefits is through personal experience and ef- 
fective training. Employees do not strive to produce erroneous decisions or to 
produce fewer decisions than they can. If an employee is making errors or underpro- 
ducing, it should be incumbent on the party that identifies those traits to provide 
an effective remedial course of instruction, tailored to the particular deficiencies 
identified. 

Question 6: What would you recommend VA do to improve its training tech- 
niques for newer employees? 

Response: A good first step would be to mandate that all Challenge Training re- 
quirements are fulfilled within a set period, and to prohibit the attention of employ- 
ees in Challenge Training from being diverted to other tasks. In addition, it would 
be beneficial if newer employees were assigned an individual mentor during their 
training and for a period after they have completed their formal training. To the 
extent possible, the mentor-trainee relationship should remain intact so that train- 
ees would not have to constantly adjust their approach to the their work to conform 
with the idiosyncrasies of multiple mentors. 

It would also be wise to segregate, to the extent possible, centralized Challenge 
Training participants into classes composed of trainees who have promoted inter- 
nally (and thus have some knowledge and experience with the VBA claims process) 
and those who are hired from outside the VBA (and who require some remedial in- 
struction regarding the mundane aspects of claims processing — e.g. how a claim is 
routed from the triage activity, to pre-development, to the rating board). That action 
would allow instructors to devote greater attention to the relative strengths and 
weakness of their classes, without running the risk of being repetitious or boring 
some participants. 

Also, after completion of Challenge Training, ongoing or remedial training must 
be presented through a single and authoritative voice. As I have suggested else- 
where, that voice should emanate from Central Office, through instructors account- 
able to Central Office who are assigned to each Regional Office. 

Question 7: What about experienced raters, would you require them to take the 
same 80 hours of training if their performance ratings were “outstanding” or “excel- 
lent”? 

Response: The protean nature of the legal requirements imposed on the VA 
claims process mandates that training be continuous in nature. Regardless of how 
well any RVSR is performing in any given period, without a constant influx of rel- 
evant information in the form of training performance will eventually suffer. More- 
over, given the real and perceived needs for increased productivity RVSRs are not 
particularly well-situated to take time out of their day and study an area where 
they have some confusion. More importantly, without relevant guidance as to proper 
procedures and accurate information regarding VBA’s policies, RVSRs are not capa- 
ble of identifying any error in their approach to their duties. So, it is vital that 
RVSRs continue to devote a discrete portion of their work year toward training. 
Having said that, the 80 hour requirement may be somewhat excessive. Attorneys 
and medical doctors in most states do not have that onerous a continuing education 
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requirement, and handle issues which are every bit as complex and important as 
those in VBA’s jurisdiction. It may be fruitful, therefore, to reduce the time VBA 
spends on continuing training by substituting relevant training developed by ref- 
erence to common adjudicatory errors for “refresher” training pertaining to the gen- 
eral rating process. Once again, if such specific training is centrally developed and 
administered, it should also foster consistency in decision-making across Regional 
Offices. 


Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 
September 22, 2008 

Kerry Baker 

Associate National Legislative Director 
Disabled American Veteran 
807 Maine Avenue, SW 
Washington, DC 20024 

Dear Mr. Baker: 


In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 
size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 


Sincerely, 


John J. Hall 
Chairman 


Post-Hearing Questions for Kerry Baker, 

Assistant National Legislative Director of the Disabled American Veterans 
From the Committee on Veterans’ Affairs, 

Subcommittee on Disability Assistance and Memorial Affairs, 

United State House of Representatives 

September 18, 2008 

Question 1: At the hearing we discussed the training requirements, what do you 
think of the substance of the training? 

Response: Although the Disabled American Veterans would like to offer an opin- 
ion as the quality and substance of the VA’s training program, we are unable to do 
so as the VA continues not to provide either this organization or any other Veterans 
Service Organization the opportunity to review their training program. 

Question 2: What do you think of VBA’s STAR program? Is it effective? 

Response: The VA’s quality assurance tool for compensation and pension claims 
is the Systematic Technical Accuracy Review (STAR) program. The DAV rec- 
ommended in its testimony of September 18, 2008, that Congress require the Sec- 
retary to report how the Department could establish a quality assurance and ac- 
countability program that will detect, track, and holds responsible those VA employ- 
ees who commit egregious errors. Such a report should be generated in consultation 
with veterans’ service organizations most experienced in the VBA claims process. 

Under the STAR program, the VA reviews a sampling of decisions from regional 
offices and uses that sampling to base its national accuracy measures regarding de- 
cisions affecting entitlements, benefit amounts, and effective dates. 
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Unfortunately, there still exists a gap in quality assurance for purposes of indi- 
vidual accountability in quality decision-making due to the current small sampling 
size the VA chooses to use. Specifically, in the STAR program, a sample is drawn 
each month from a regional office workload divided between ratings, authorizations, 
and fiduciary end-products. A monthly sample of “rating”-related cases generally re- 
quires a STAR review of 10 rating-related end products. Reviewing 10 rating-related 
cases per month for an average size regional office that could easily employee more 
than three times that number of raters, is undeniable evidence of a total void and 
lack of commitment in individual accountability. 

If an average size regional office produced only 1,000 decisions per month, which 
we feel is quite conservative, the STAR program would only review 1 percent of the 
total cases decided by that regional office. Those figures leave no room for trend 
analysis, much less personal accountability. 

To put this in better perspective, according to VA’s 2007 performance and ac- 
countability report, the STAR program reviewed 11,056 compensation and pension 
(C&P) cases in 2006 for improper payments whereas, the total number of C&P cases 
actually available for review was 1,540,211. This equals a percentage of cases re- 
viewed of approximately seven tenths of 1 percent, or 0.72 percent. 

In closing, we find the STAR program does not fare well as an effective manage- 
ment oversight tool for the VA. It offers only minute sampling of cases compared 
to actual through-put and it has no accountability mechanism. Effective account- 
ability can be engineered in a manner that holds each VBA employee responsible 
for his/her work as a claim moves through the system while at the same time hold- 
ing all employees responsible simultaneously. As errors are discovered, the respon- 
sible employees must be held accountable by forfeiture of work credit percentage. 
One employee would be far less likely to cover for errors or look the other way from 
errors committed by a fellow employee if they knew their performance standards 
were equally at risk. This type of system would ensure personal accountability at 
every stage in the claims process, an essential element if STAR is to ever become 
an effective management oversight system. 


Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 

September 25, 2008 

Ronald B. Abrams 
Joint Executive Director 
National Veterans Legal Services Program 
1600 K Street, NW, Suite 500 
Washington, DC 20006-2833 

Dear Mr. Abrams: 

In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 
size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 

Sincerely, 


John J. Hall 
Chairman 
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Response From Ronald Abrams for 
Question From the House Committee on Veterans’ Affairs, 

Subcommittee on Disability Assistance and Memorial Affairs Hearing on 
“Examining the Effectiveness of Veterans Benefits Administration Training 
and Performance Management and Accountability” 

September 18, 2008 

Question 1: When NVLSP conducts its Quality Reviews along with The American 
Legion, does it consistently look at the quality of training as well. If so, what is your 
feedback on the training and what suggestions have you made over the years. 

Response: The answer is yes. 

NVLSP attorneys are part of The American Legion (Legion) team that conducts 
quality reviews at VA regional offices (ROs). Over the past few years, NVLSP attor- 
neys working with Legion Quality Review Teams visited more than 40 VA regional 
offices for the purpose of assessing overall operation. In general the quality reviews 
conducted by the Legion/NVLSP team reveal that RO training suffers because at too 
many regional offices there are too few experienced supervisors that could provide 
trainee adjudicators and senior adjudicators proper mentoring and quality assur- 
ance. Also we learned that many ROs postponed or suspended training so that max- 
imum effort could be expended on production. 

The Legion/NVLSP teams found that there is a general inconsistency in how re- 
gional office employees are trained and how training is implemented. For example, 
some stations have regular formalized or structured training programs, while others 
have training programs that are best described as more informal and sporadic. 
Some stations have well established and structured training for new employees, but 
ongoing training for experienced staff is very limited. These finding are similar to 
a 2005 OIG study. 

The Legion, in past testimony, recommended that VA reduce its reliance on locally 
developed training materials and on-the-job training by senior raters. The Legion 
suggested that the ROs develop training packages based on errors noted the na- 
tional STAR report and from patterns of errors found by the Board of Veterans’ Ap- 
peals. Allowing the many regional offices to heavily rely on locally developed train- 
ing initiatives increases the likelihood of balkanization and great variance in rating 
decisions. Unless regional offices (both managers and individual adjudicators) learn 
from their mistakes and take corrective action, there will continue to be a high rate 
of improperly adjudicated claims, resulting in a consistently high appeals rate and 
subsequent high BVA remand/reversal rate of regional office decisions. 

Below is a sample of our comments about training based on the Legion/NVLSP 
quality reviews. 

HOUSTON VA REGIONAL OFFICE 

Interviews with RO employees identified several issues that may adversely affect 
morale, and the quality of RO adjudications. . . . Training is conducted on a weekly 
basis but several RO employees rated the training as poor. They felt that the train- 
ers were not qualified to give the training, or not enthused about giving the train- 
ing. A common complaint was that most trainers merely read off overhead projectors 
or from a manual. Some staff suggested that a “Train the Trainer” program would 
be beneficial. 

BUFFALO VA REGIONAL OFFICE 

Training is being completed on a regular basis, approximately two to three times 
per month. The Team found the RO training plan to be satisfactory but employees 
are often encouraged not to spend time on training due to workload concerns. 

RENO VA REGIONAL OFFICE 

The station is in compliance with the 80 hours of required training mandated by 
VA Central Office. Both formal and informal training sessions are also conducted 
on a regular basis as well as continual “on-the job-training.” 

MUSKOGEE VA REGIONAL OFFICE 

The station’s training program is divided into two main categories: initial training 
and continuous training. The bulk of training is for new hires. After completing pre- 
requisite training, new hires are sent to “Challenge Training” in nearby training 
hubs such as Milwaukee or Chicago for 3 weeks. After completing “Challenge Train- 
ing,” new hires continue their education through web-based training modules and 
on-the-job training. Continuous training is made up of both computer-based web- 
based training and formal classroom training, which is often led by the training co- 
ordinator, the Service Center Manager, Decision Review Officers and rating special- 
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ists. This training is usually conducted once or twice a month to meet the Central 
Office standard of 80 hours of training a year. 

PHOENIX VA REGIONAL OFFICE 

In addition to a training program for new employees, there is also ongoing train- 
ing in place for experienced personnel. The DRO compiles, for training purposes, de- 
tailed information on trends and reversals on appealed cases. Also, when appealed 
decisions are reversed by the DRO, the individual responsible for the original deci- 
sion is informed of the action taken by the DRO and provided specific reasons for 
such action. This allows management to maintain accountability, identify problem 
areas, direct training accordingly and, as a result, improve the overall quality of de- 
cisions. 

Prior to the establishment of the Appeals Management Center (AMC), the DRO 
also prepared a complete list, used in conjunction with training, summarizing rea- 
sons for remands broken down by individual cases. Since the establishment of the 
AMC, the station has not been able to compile detailed information on individual 
remands nor identify trends for remands sent to the AMC. Although the appeals 
team receives summaries of reasons for remand, they are only by region and there 
is nothing specific for the individual stations. Not being able to identify reasons for 
remand by individual station will adversely impact the station’s ability to identify 
remand trends and take corrective action. Additionally, there is no mechanism in 
place at the station for tracking BVA allowances. This not only makes it more dif- 
ficult to respond to or prevent delays in payment authorization, as previously dis- 
cussed, it negatively impacts training and, in turn, the quality of decisions. By not 
tracking reasons for BVA allowances, which are reversals of RO denials, the station 
is missing an important opportunity to identify trends in erroneous denials and take 
necessary action to avoid such errors in the future. 

PITTSBURGH VA REGIONAL OFFICE 

Training for DROs, RVSRs, and VSRs is conducted on a regular basis. Training 
sessions are video taped for staff who couldn’t attend and for those that work at 
home. Station work performance standards do not exceed standards established by 
VA Central Office. . . . 

The station does not have a mechanism in place for tracking BVA allowances. 
This negatively impacts training and, in turn, quality of decisions. By not tracking 
reasons for BVA allowances, which are reversals of RO denials, the station is miss- 
ing an important opportunity to identify trends in erroneous denials and take nec- 
essary action to avoid such errors in the future. Additionally, as BVA remands, in 
most instances, are being sent to the Appeals Management Center (AMC) for devel- 
opment, the station is denied the opportunity to review and track individual re- 
mands. Although the appeals team receives summaries of reasons for remand by re- 
gion, there is nothing specific for individual stations. Not being able to identify rea- 
sons for remand by individual station will adversely impact the station’s ability to 
identify remand trends, include in training and take corrective action. 

ST. PETERSBURG VA REGIONAL OFFICE 

. . . According to station management, current staffing is now largely made up 
of individuals with limited training and limited experience. We were informed that 
once basic training is completed, the only training conducted is that which is specifi- 
cally mandated by VBA. There is no ongoing training program. With the current 
emphasis on production quotas and reducing the claims backlog, management is un- 
willing to take time away from production for training. 

It was noted that there were too few managers/supervisors and many of them 
lacked management training. It was also noted that some inexperienced trainers 
were assigned to train new employees. 
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Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 
September 22, 2008 

Dr. Patricia Keenan 
Program Manager 

Human Resources Research Organization 
66 Canal Center Plaza, Suite 400 
Alexandria, VA 22314-1591 
Washington, DC 20548 

Dear Ms. Keenan: 


In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 
size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 


Sincerely, 


John J. Hall 
Chairman 


Response to Questions From the House Committee on Veterans’ Affairs 

Subcommittee on Disability Assistance and Memorial Affairs Hearing on 
“Examining the Effectiveness of Veterans Benefits Administration Training 
and Performance Management and Accountability” 

Patricia A Keenan, HumRRO 

Question 1: You mentioned the focus groups that you conducted with raters and 
noted that they develop their own “individual rules.” Can you tell me more about 
this practice? Do you have examples of what raters are doing when the medical evi- 
dence is ambiguous? 

Response: I would be reluctant to characterize this as a “practice,” which makes 
the activity sound institutionalized. I see it as a coping mechanism that helps indi- 
viduals reduce the stress associated with working in a situation that involves a high 
level of decision-making under uncertainty. It probably contributes to the variance 
in rating decisions as raters develop their own heuristics. 

My response is based on what we heard in focus groups and what I have learned 
about the RVSR job over the last few years as we have developed the RVSR and 
journey-level RVSR skills certification tests. 

We heard consistently that it takes several years for RVSRs to become com- 
fortable making rating decisions. There are several reasons for this. These are very 
high stakes decisions, with a large impact on the lives of veterans and their fami- 
lies. Raters would understandably be very wary about making an error that could 
hurt these people. Many inexperienced raters are afraid of making a mistake that 
results in the case being appealed. Experienced raters have learned that everyone 
is going to have a case appealed sooner or later, that there are a variety of reasons 
for this happening (e.g., new evidence, error, differing interpretation of the regula- 
tion), and it should not prevent a decision. A third reason is that the criteria in 
some parts of the Rating Schedule are not sufficiently detailed to allow the rater 
to feel confident that an evaluation is exactly correct. For example, when rating a 
complaint for a disorder of the ulnar nerve, the schedule provides a detailed descrip- 
tion of complete paralysis; however, no description is given for lesser evaluations 
characterized as severe, moderate or mild. 

The first two problems are overcome through experience; the third is more prob- 
lematic. Currently, when there is no clear guidance in the Rating Schedule, RVSRs 
either try to reason the problem through on their own or solicit help from their 
peers, coaches or Decision Review Officers (who serve as RVSR trainers). Reasoning 
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through on their own is mostly likely where developing individual decision rules is 
rooted. Trainee RVSRs have a mentor (a journey-level RVSR) with whom they dis- 
cuss the evidence and compare it to the available guidance (e.g., the Rating Sched- 
ule, training materials, FAST letters). Discussing the claim with others allows the 
RVSR to take advantage of prior experiences of colleagues as well as their knowl- 
edge of the Rating Schedule. Some Service Centers (e.g., San Diego) have a medical 
professional (retired doctor or nurse) on site to help RVSRs with this type of situa- 
tion. These people are familiar with the rating process and the Rating Schedule and 
can help the rater interpret the medical information and match it to the appropriate 
section of the Rating Schedule. Seeking input from others probably means that 
these individual decision rules become shared within an office. 

While the process is very understandable, it is important to recognize that this 
is not solely a training problem. The deeper roots are in the lack of detailed criteria 
in some areas of the Rating Schedule and the time pressure raters work under in 
trying to keep up with the ever increasing number of claims. 

Question 2: The practice of using analogous codes has increasingly permeated 
VA’s rating process over the years and as you observed increases subjectivity and 
variance. This seems very unfair to the veteran. What would you suggest VA do in- 
stead of using these codes and how could they better train employees to reduce this 
subjectivity? 

Response: The use of analogous codes is not unfair, in and of itself. There are 
legitimate reasons for using them. The first is that maintenance of the Rating 
Schedule has not kept pace with medical discoveries and advancements. Many of 
these conditions had not been recognized at the time the Schedule was developed, 
so they were not included. The result is that many relatively common conditions 
(e.g., Cohn’s disease, erectile dysfunction, insomnia, shin splints) are not currently 
included in the Rating Schedule. As the Schedule is updated, the conditions will 
likely be added to the appropriate section(s). Updating the Schedule, however, is 
likely to take years due to the enormity of the effort. It might be more expedient 
for VA to conduct a study to analyze the use of analogous codes and identify impair- 
ments that occur often enough to deserve their own code or for which the criteria 
in existing codes are not adequate. 

Conducting such a study is not a simple proposition as the data are not nec- 
essarily easy to interpret. For example, raters may use at least two different diag- 
nostic codes to rate Cohn’s disease. This use of multiple diagnostic codes makes it 
difficult to track the number of Cohn’s disease claims which, in turn, makes it dif- 
ficult to recognize when the number of cases would justify establishment of a sepa- 
rate diagnostic code. 

A second reason for using analogous codes is that there are some symptoms that 
are not easily diagnosed. Indeed, the “Persian Gulf War Veterans’ Benefits Act ” rec- 
ognizes that many Gulf War (GW) veterans suffer from chronic disabilities (e.g., fa- 
tigue, headache) resulting from an undiagnosed illnesses. The Code of Federal Regu- 
lations (38 CFR, Part II, Chapter 11, Subchapter 11, §1117) specifies the use of 
analogous codes for evaluating these undiagnosed illnesses. Other times, a medical 
opinion does not specify a particular condition. The diagnosis may say that the 
symptoms are “like” a recognized, diagnosable condition, but that condition is not 
exactly applicable to the symptoms. In these cases, the rater should use a code that 
is analogous to the recognized condition. It is likely that this circumstance will 
never disappear, so analogous codes will always have a place in the rating process. 

Some studies have suggested using the same diagnostic categories ( International 
Classification of Diseases (ICD) and Diagnostic and Statistical Manual for Mental 
Disorders (DSM)) used by VHA and other health-care providers. While there are 
some advantages to doing so, to do a wholesale change would cause a major up- 
heaval in the rating process. It would take a lot of time to develop new training 
materials/classes and job aids. Conducting training would require that RVSRs take 
a good deal of time away from their job to learn the new material. It might be more 
feasible to add parts of the ICD to the existing Rating Schedule, making the transi- 
tion over time. 

For both situations, C&P Services could update the Rating Schedule and/or de- 
velop training and job aids for RVSRs to learn the new diagnostic codes. The prob- 
lem of working with analogous codes properly is not entirely a training matter, al- 
though that is certainly one avenue to pursue. C&P Service could review existing 
training materials to make sure they provide adequate guidance for raters. It might 
be informative to gather input from raters as to the type of information they think 
would be most useful to them. C&P could also develop additional guidelines for 
identifying analogous codes. For example, raters might find it useful to take the 
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time (or feel they had the time) to do a quick search of the Internet to give them 
information they might use to find the appropriate diagnostic code. 

Question 3: You outlined 3 recommendations in your testimony on September 18, 
2008. Have you previously presented these ideas to VA and what was their re- 
sponse? 

Response: No, I had not discussed these ideas with VA. As a contractor working 
on the skills certification program, it was not my role to advise VA on areas outside 
the scope of that work. 


Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 
September 22, 2008 

Michael Walcoff 

Deputy Under Secretary for Benefits 
Veterans Benefits Administration 
U.S. Department of Veterans Affairs 
810 Vermont Avenue, NW 
Washington, DC 20420 

Dear Mr. Walcoff: 

In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 
size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 

Sincerely, 

John J. Hall 
Chairman 


Questions for the Record 

The Honorable John J. Hall, Chairman, 

Subcommittee on Disability Assistance and Memorial Affairs, 

House Committee on Veterans’ Affairs 

September 18, 2008 

Examining the Effectiveness of Veterans Benefits Administration Training 
and Performance Management and Accountability 

Question 1: What does VBA do about tying training to individual employee per- 
formance? 

Response: Supervisors are required to conduct oversight of employee training 
plans and are held responsible for ensuring that employees meet their training re- 
quirements. Employee training is tracked through the learning management system 
(LMS). Through LMS, employees complete a detailed 80-hour training plan each 
year, which contains curricula deemed appropriate to achieve successful perform- 
ance in their position. In addition to the required course work, employees can add 
courses to their learning plan. In fiscal 2008, the Veterans Benefits Administration 
(VBA) hired training managers to provide additional oversight of the scheduling, 
and completion of training. 

In the event an employee’s performance is not meeting the fully successful level 
of achievement for a critical element, the employee will be placed on a performance 
improvement plan (PIP). The PIP identifies the employee’s specific performance defi- 
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ciencies; the action(s) that must be taken by the employee to improve to the success- 
ful level of performance; the methods that will be employed to measure the improve- 
ment; and assistance to be provided such as counseling, or focused individualized 
training. 

Question 2: In your testimony you noted that VBA contracted with an inde- 
pendent consultant to evaluate the Challenge Training. Although, we discussed this 
briefly, can the Subcommittee staff get a copy of those results? 

Response: As part of its national level training evaluation program, VBA con- 
tracted for an evaluation of the challenge program. The evaluation sought to answer 
two questions: 

• Does challenge training, as implemented, provide value to VBA? 

• What are the opportunities for improving challenge training? 

The report indicates that much value has been realized by VBA’s efforts to pro- 
vide quality, timely training to its new claims processing employees. It also noted 
areas where VBA could improve the overall management and curriculum of chal- 
lenge. Efforts are already underway to address the recommendations. A copy of the 
report is attached. 

[The report is being retained in the Committee files.] 

Question 3: How does the information gathered from the STAR review get inte- 
grated with the information from the Compensation and Pension Evaluation Pro- 
gram (CPEP) reviews regarding the quality of the exams conducted in cooperation 
with the Veterans Health Administration? 

Response: There is no mechanism for integration of systematic technical accu- 
racy review (STAR) and CPEP reviews. However, the STAR questions and the 
CPEP key indicator questions are similar and essentially cover the appropriateness 
of the exam request. CPEP reviews are focused on the quality of the examination 
and STAR reviews are based upon the accuracy of the resulting decisions from those 
examinations. 

Question 4: At the hearing, the Chairman asked about the time in motion study, 
can you please share those results with the Subcommittee as well? 

Response: VBA contracted with SRA International, Inc., to conduct a work meas- 
urement study in March 2007 at 15 regional offices. VBA’s pension maintenance 
centers, benefits delivery at discharge rating activity sites, and foreign claims proc- 
essing offices were among the regional offices selected to participate in the study. 
The electronic work measurement application final work rate standards report, sub- 
mitted by SRA International, is attached. 

[The report is being retained in the Committee files.] 

The work rates standards provided in SRA’s final report contained some unex- 
pected results, such as longer processing times for original disability compensation 
claims with 7 issues or less than for claims with 8 issues or more, which prompted 
a thorough review of the methodology used in the study. Critical flaws were uncov- 
ered that produced inaccurate results. The primary errors included: 

• Some completed claims were double counted, resulting in artificially low work- 
rate standards. 

• Brokered work (those claims completed by select regional offices for other re- 
gional offices) was not included in SRA’s computations. Not including brokered 
work inflated the work-rate standard at the regional office completing the work 
and lowered the work-rate standard at the office of original jurisdiction. It also 
influenced the overall work-rate standard since only a fraction of regional of- 
fices were included in the study. 

• Several formula errors were uncovered in the work-rate standard spreadsheet 
compiled by SRA that affected the outcome of the study. The errors causing the 
greatest impact on the work-rate standard calculations were observation count 
computations. 

Revisions were made by VBA to the work-rate standards spreadsheet in an at- 
tempt to remedy the above issues. The resulting data was then re-analyzed and 
compared to prior work-measurement study findings. The changes from prior find- 
ings were substantial and found to be associated with the factors below: 

• Inconsistent adherence to guidance among participating regional offices on clear- 
ing appeals-related claims. A reliable number of completed appeals-related 
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claims were unavailable; therefore, no valid conclusion could be drawn from the 
work-measurement results. 

• Lack of record of the types of brokered claims completed. Without a record of 
the exact types of brokered claims completed, completed claims counts could not 
be properly credited or debited, leading to results not reflective of true work- 
loads. 

• Pension-related claim results were questionable. Prior studies ran for 4 months 
to account for the cyclical nature of the pension workload. The 2007 study was 
conducted for only 1 month, providing a narrower view of the pension workload 
cycle. 

• The sample size for several claim types was too small or nonexistent. Because 
of the small to nonexistent sample size, the results were unreliable. This again 
was due to the fact that the study only ran for 30 days. 

The above issues contributed to a wide variation of results between participating 
regional offices. This disparity led to the conclusion that the results could not be 
representative of the time to process claims. It was therefore decided to not use the 
results of the work measurement study. 

The recently mandated study of the work credit system and work management 
system will measure and manage the work production of VBA employees who han- 
dle claims for compensation and pension benefits and will also evaluate more effec- 
tive means of improving performance. Lessons learned from the 2007 study will be 
used to ensure a valid methodology. 


Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 
September 22, 2008 

Bradley Mayes 
Director 

Compensation and Pension Service 
Veterans Benefits Administration 
U.S. Department of Veterans Affairs 
810 Vermont Avenue, NW 
Washington, DC 20420 

Dear Mr. Mayes: 

In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 
size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 

Sincerely, 


John J. Hall 
Chairman 
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Questions for the Record 

The Honorable John J. Hall, Chairman, 

Subcommittee on Disability Assistance and Memorial Affairs, 

House Committee on Veterans’ Affairs 

September 18, 2008 

Examining the Effectiveness of Veterans Benefits Administration Training 
and Performance Management and Accountability 

Question 1: When the ROs report their 80 hours of training, do you know what 
materials they trained on or just that they completed the required hours? 

Response: Employees are required to complete 60 hours of core technical train- 
ing. The topics for the core training are identified by Compensation and Pension 
(C&P) service. The remaining 20 hours are determined by the Regional Office (RO) 
based on local needs. The topics and numbers of hours each employee completes are 
recorded in the learning management system. 

Question 2: What level of supervision does C&P Service provide to the RO re- 
garding training? 

Response: C&P service reviews the training accomplishments of each RO at the 
end of the fiscal year to ensure training requirements were met. Feedback from the 
reviews is provided to the regional offices. 


Committee on Veterans’ Affairs 
Subcommittee on Disability Assistance 
and Memorial Affairs 
Washington, DC. 
September 25, 2008 

Dorothy Mackay 
Director 

Employee Development and Training 
Veterans Benefits Administration 
U.S. Department of Veterans Affairs 
810 Vermont Avenue, NW 
Washington, DC 20420 

Dear Ms. Mackay: 

In reference to our House Committee on Veterans’ Affairs Subcommittee on Dis- 
ability Assistance and Memorial Affairs Hearing on “Examining the Effectiveness of 
Veterans Benefits Administration Training and Performance Management and Ac- 
countability” on September 18, 2008, I would appreciate it if you could answer the 
enclosed hearing questions as soon as possible. 

In an effort to reduce printing costs, the Committee on Veterans’ Affairs, in co- 
operation with the Joint Committee on Printing, is implementing some formatting 
changes for material for all full committee and subcommittee hearings. Therefore, 
it would be appreciated if you could provide your answers consecutively on letter 
size paper, single-spaced. In addition, please restate the question in its entirety be- 
fore the answer. 

Sincerely, 


John J. Hall 
Chairman 
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Questions for the Record 

The Honorable John J. Hall, Chairman, 

Subcommittee on Disability Assistance and Memorial Affairs, 

House Committee on Veterans’ Affairs 

September 18, 2008 

Examining the Effectiveness of Veterans Benefits Administration Training 
and Performance Management and Accountability 

Question 1: When RO’s develop their training strategic plan, how are the gaps 
identified and incorporated into future training? 

Response: In fiscal 2008, the Veterans Benefit Administration (VBA) created a 
training manager position at every regional office (RO) to improve the ability to 
identify gaps and plan training. The training manager is responsible for local train- 
ing reviews, analyzing performance indicators to determine local training needs, and 
implementing the training necessary to meet those needs. For example, local accu- 
racy reviews are conducted by the Compensation and Pension (C&P) service’s sys- 
tematic technical accuracy review (STAR) staff on claims decisions using national 
quality criteria. The results of the reviews are available to the RO training manager 
for trend analysis and formulation of remedial training as necessary. 

Question 1(a): How does joint data collection and root cause analyses with the 
VBA on cases that have been remanded inform training? 

Response: The C&P program review staff conducts monthly remand reviews of 
all pre-certification Board of Veterans Appeals (BVA) remands. The review results 
are available to all ROs on the C&P Intranet and are used to provide timely feed- 
back on pre-certification remands in support of efforts to reduce avoidable remands. 
The results are also used for training purposes. As an example, BVA travel board 
attorneys use the results when they provide training at the regional offices. 

Recently, analysis was conducted that compared the primary STAR error for Vet- 
erans Claims Assistance Act (VCAA) compliant development to the corresponding 
pre-certification error categories on the remand reasons report. The results are 
under review. 

Detailed remand reason reports are run quarterly and are also posted on the C&P 
Intranet Web site by RO, area, and nationwide. 

Question 2: The Instructors Training manual is five volumes. That doesn’t seem 
like an effective tool. Have you consulted with private sector organizations that spe- 
cialize in developing training protocols for Federal and private sector agencies? 

Response: The instructors’ training manual includes training materials for the 
three challenge training classes, each given over the course of 3 weeks. The three 
challenge curriculums include rating veterans service representative (RVSR), pre- 
determination veterans service representative (VSR) and post-determination VSR. 
The manual is split into five volumes, two for RVSR training, one for pre-determina- 
tion VSR training, and two for post-determination VSR training. Each volume in- 
cludes instructor and student guides, presentations, and reference materials, includ- 
ing copies of fast letters, court decisions, flow charts, and sample letters. 

VBA is currently exploring ways to reduce the size of the training manuals as the 
curriculum is revised. All training materials are reviewed by internal certified in- 
structional design specialists. VBA also works with a contractor, Camber Corpora- 
tion, on the materials. 
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